Nov 30 08:01:49 user nova-compute[74963]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74963) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 08:01:49 user nova-compute[74963]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74963) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 08:01:49 user nova-compute[74963]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74963) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 08:01:49 user nova-compute[74963]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:01:50 user nova-compute[74963]: INFO nova.virt.driver [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 30 08:01:50 user nova-compute[74963]: INFO nova.compute.provider_config [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] Acquiring lock "singleton_lock" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] Acquired lock "singleton_lock" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] Releasing lock "singleton_lock" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] Full set of CONF: {{(pid=74963) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ******************************************************************************** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] Configuration options gathered from: {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ================================================================================ {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] allow_resize_to_same_host      = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] arq_binding_timeout            = 300 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] backdoor_port                  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] backdoor_socket                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] block_device_allocate_retries  = 300 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] block_device_allocate_retries_interval = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cert                           = self.pem {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute_monitors               = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] config_dir                     = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] config_drive_format            = iso9660 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] config_source                  = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] console_host                   = user {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] control_exchange               = nova {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cpu_allocation_ratio           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] daemon                         = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] debug                          = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] default_access_ip_network_name = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] default_availability_zone      = nova {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] default_ephemeral_format       = ext4 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] default_green_pool_size        = 1000 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] default_schedule_zone          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] disk_allocation_ratio          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] enable_new_services            = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] enabled_ssl_apis               = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] flat_injected                  = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] force_config_drive             = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] force_raw_images               = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] graceful_shutdown_timeout      = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] heal_instance_info_cache_interval = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] host                           = user {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] instance_build_timeout         = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] instance_delete_interval       = 300 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] instance_name_template         = instance-%08x {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] instance_usage_audit           = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] instance_usage_audit_period    = month {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] internal_service_availability_zone = internal {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] key                            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] live_migration_retry_count     = 30 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] log_config_append              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] log_dir                        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] log_file                       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] log_options                    = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] log_rotate_interval            = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] log_rotate_interval_type       = days {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] log_rotation_type              = none {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] long_rpc_timeout               = 1800 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] max_concurrent_builds          = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] max_concurrent_live_migrations = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] max_concurrent_snapshots       = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] max_local_block_devices        = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] max_logfile_count              = 30 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] max_logfile_size_mb            = 200 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] maximum_instance_delete_attempts = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] metadata_listen                = 0.0.0.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] metadata_listen_port           = 8775 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] metadata_workers               = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] migrate_max_retries            = -1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] mkisofs_cmd                    = genisoimage {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] my_ip                          = 10.0.0.210 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] network_allocate_retries       = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] osapi_compute_listen_port      = 8774 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] osapi_compute_unique_server_name_scope =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] osapi_compute_workers          = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] password_length                = 12 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] periodic_enable                = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] periodic_fuzzy_delay           = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] pointer_model                  = ps2mouse {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] preallocate_images             = none {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] publish_errors                 = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] pybasedir                      = /opt/stack/nova {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ram_allocation_ratio           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] rate_limit_burst               = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] rate_limit_except_level        = CRITICAL {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] rate_limit_interval            = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] reboot_timeout                 = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] reclaim_instance_interval      = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] record                         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] reimage_timeout_per_gb         = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] report_interval                = 120 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] rescue_timeout                 = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] reserved_host_cpus             = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] reserved_host_disk_mb          = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] reserved_host_memory_mb        = 512 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] reserved_huge_pages            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] resize_confirm_window          = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] resize_fs_using_block_device   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] resume_guests_state_on_host_boot = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] rpc_response_timeout           = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] run_external_periodic_tasks    = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] running_deleted_instance_action = reap {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] running_deleted_instance_timeout = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler_instance_sync_interval = 120 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_down_time              = 720 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] servicegroup_driver            = db {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] shelved_offload_time           = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] shelved_poll_interval          = 3600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] shutdown_timeout               = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] source_is_ipv6                 = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ssl_only                       = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] state_path                     = /opt/stack/data/nova {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] sync_power_state_interval      = 600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] sync_power_state_pool_size     = 1000 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] syslog_log_facility            = LOG_USER {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] tempdir                        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] timeout_nbd                    = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] transport_url                  = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] update_resources_interval      = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] use_cow_images                 = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] use_eventlog                   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] use_journal                    = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] use_json                       = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] use_rootwrap_daemon            = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] use_stderr                     = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] use_syslog                     = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vcpu_pin_set                   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plugging_is_fatal          = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plugging_timeout           = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] virt_mkfs                      = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] volume_usage_poll_interval     = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] watch_log_file                 = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] web                            = /usr/share/spice-html5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_concurrency.disable_process_locking = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.auth_strategy              = keystone {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.compute_link_prefix        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.dhcp_domain                = novalocal {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.enable_instance_password   = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.glance_link_prefix         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.instance_list_per_project_cells = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.list_records_by_skipping_down_cells = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.local_metadata_per_cell    = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.max_limit                  = 1000 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.metadata_cache_expiration  = 15 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.neutron_default_tenant_id  = default {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.use_forwarded_for          = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.use_neutron_default_nets   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.vendordata_dynamic_targets = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.vendordata_jsonfile_path   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.backend_argument         = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.config_prefix            = cache.oslo {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.dead_timeout             = 60.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.debug_cache_backend      = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.enable_retry_client      = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.enable_socket_keepalive  = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.enabled                  = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.expiration_time          = 600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.hashclient_retry_attempts = 2 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_dead_retry      = 300 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_password        =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_sasl_enabled    = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.memcache_username        =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.proxies                  = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.retry_attempts           = 2 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.retry_delay              = 0.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.socket_keepalive_count   = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.socket_keepalive_idle    = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.socket_keepalive_interval = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.tls_allowed_ciphers      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.tls_cafile               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.tls_certfile             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.tls_enabled              = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cache.tls_keyfile              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.auth_section            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.auth_type               = password {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.cafile                  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.certfile                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.collect_timing          = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.cross_az_attach         = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.debug                   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.endpoint_template       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.http_retries            = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.insecure                = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.keyfile                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.os_region_name          = RegionOne {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.split_loggers           = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cinder.timeout                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.cpu_dedicated_set      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.cpu_shared_set         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.image_type_exclude_list = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.resource_provider_association_refresh = 300 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.shutdown_retry_interval = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] conductor.workers              = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] console.allowed_origins        = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] console.ssl_ciphers            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] console.ssl_minimum_version    = default {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] consoleauth.token_ttl          = 600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.cafile                  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.certfile                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.collect_timing          = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.connect_retries         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.connect_retry_delay     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.endpoint_override       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.insecure                = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.keyfile                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.max_version             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.min_version             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.region_name             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.service_name            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.service_type            = accelerator {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.split_loggers           = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.status_code_retries     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.status_code_retry_delay = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.timeout                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] cyborg.version                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.backend               = sqlalchemy {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.connection            = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.connection_debug      = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.connection_parameters =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.connection_recycle_time = 3600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.connection_trace      = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.db_inc_retry_interval = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.db_max_retries        = 20 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.db_max_retry_interval = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.db_retry_interval     = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.max_overflow          = 50 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.max_pool_size         = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.max_retries           = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.mysql_wsrep_sync_wait = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.pool_timeout          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.retry_interval        = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.slave_connection      = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] database.sqlite_synchronous    = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.backend           = sqlalchemy {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.connection        = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.connection_debug  = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.connection_parameters =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.connection_recycle_time = 3600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.connection_trace  = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.db_inc_retry_interval = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.db_max_retries    = 20 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.db_max_retry_interval = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.db_retry_interval = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.max_overflow      = 50 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.max_pool_size     = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.max_retries       = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.pool_timeout      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.retry_interval    = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.slave_connection  = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] api_database.sqlite_synchronous = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] devices.enabled_mdev_types     = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ephemeral_storage_encryption.enabled = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.api_servers             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.cafile                  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.certfile                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.collect_timing          = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.connect_retries         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.connect_retry_delay     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.debug                   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.default_trusted_certificate_ids = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.enable_certificate_validation = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.enable_rbd_download     = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.endpoint_override       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.insecure                = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.keyfile                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.max_version             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.min_version             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.num_retries             = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.rbd_ceph_conf           =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.rbd_connect_timeout     = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.rbd_pool                =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.rbd_user                =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.region_name             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.service_name            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.service_type            = image {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.split_loggers           = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.status_code_retries     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.status_code_retry_delay = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.timeout                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.verify_glance_signatures = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] glance.version                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] guestfs.debug                  = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.config_drive_cdrom      = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.config_drive_inject_password = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.enable_remotefx         = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.instances_path_share    =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.limit_cpu_features      = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.use_multipath_io        = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.vswitch_name            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] mks.enabled                    = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] image_cache.manager_interval   = 2400 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] image_cache.precache_concurrency = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] image_cache.remove_unused_base_images = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] image_cache.subdirectory_name  = _base {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.api_max_retries         = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.api_retry_interval      = 2 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.auth_section            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.auth_type               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.cafile                  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.certfile                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.collect_timing          = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.conductor_group         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.connect_retries         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.connect_retry_delay     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.endpoint_override       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.insecure                = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.keyfile                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.max_version             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.min_version             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.peer_list               = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.region_name             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.serial_console_state_timeout = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.service_name            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.service_type            = baremetal {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.split_loggers           = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.status_code_retries     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.status_code_retry_delay = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.timeout                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ironic.version                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] key_manager.fixed_key          = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.barbican_api_version  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.barbican_endpoint     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.barbican_endpoint_type = public {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.barbican_region_name  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.cafile                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.certfile              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.collect_timing        = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.insecure              = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.keyfile               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.number_of_retries     = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.retry_delay           = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.send_service_user_token = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.split_loggers         = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.timeout               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.verify_ssl            = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican.verify_ssl_path       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican_service_user.auth_section = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican_service_user.auth_type = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican_service_user.cafile   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican_service_user.certfile = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican_service_user.collect_timing = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican_service_user.insecure = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican_service_user.keyfile  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican_service_user.split_loggers = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] barbican_service_user.timeout  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.approle_role_id          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.approle_secret_id        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.cafile                   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.certfile                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.collect_timing           = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.insecure                 = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.keyfile                  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.kv_mountpoint            = secret {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.kv_path                  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.kv_version               = 2 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.namespace                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.root_token_id            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.split_loggers            = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.ssl_ca_crt_file          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.timeout                  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.use_ssl                  = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.auth_section          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.auth_type             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.cafile                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.certfile              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.collect_timing        = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.connect_retries       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.connect_retry_delay   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.endpoint_override     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.insecure              = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.keyfile               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.max_version           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.min_version           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.region_name           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.service_name          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.service_type          = identity {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.split_loggers         = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.status_code_retries   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.status_code_retry_delay = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.timeout               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] keystone.version               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.connection_uri         =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.cpu_mode               = custom {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: WARNING oslo_config.cfg [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.cpu_power_governor_high = performance {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.cpu_power_management   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.device_detach_attempts = 8 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.device_detach_timeout  = 20 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.disk_cachemodes        = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.disk_prefix            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.enabled_perf_events    = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.file_backed_memory     = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.gid_maps               = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.hw_disk_discard        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.hw_machine_type        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.images_rbd_pool        = rbd {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.images_type            = default {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.images_volume_group    = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.inject_key             = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.inject_partition       = -2 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.inject_password        = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.iscsi_iface            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.iser_use_multipath     = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_downtime = 500 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_inbound_addr = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_scheme  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_timeout_action = abort {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_tunnelled = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: WARNING oslo_config.cfg [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 30 08:01:50 user nova-compute[74963]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 30 08:01:50 user nova-compute[74963]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 30 08:01:50 user nova-compute[74963]: and ``live_migration_inbound_addr`` respectively.
Nov 30 08:01:50 user nova-compute[74963]: ).  Its value may be silently ignored in the future.
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.live_migration_with_native_tls = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.max_queues             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.nfs_mount_options      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.num_pcie_ports         = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.pmem_namespaces        = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.quobyte_client_cfg     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rbd_secret_uuid        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rbd_user               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rescue_image_id        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rescue_kernel_id       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.rx_queue_size          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.smbfs_mount_options    =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.snapshot_compression   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.snapshot_image_format  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.sparse_logical_volumes = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.swtpm_enabled          = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.swtpm_group            = tss {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.swtpm_user             = tss {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.sysinfo_serial         = unique {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.tb_cache_size          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.tx_queue_size          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.uid_maps               = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.use_virtio_for_bridges = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.virt_type              = kvm {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.volume_clear           = zero {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.volume_clear_size      = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.volume_use_multipath   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.vzstorage_cache_path   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.auth_section           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.auth_type              = password {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.cafile                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.certfile               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.collect_timing         = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.connect_retries        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.connect_retry_delay    = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.default_floating_pool  = public {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.endpoint_override      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.extension_sync_interval = 600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.http_retries           = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.insecure               = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.keyfile                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.max_version            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.min_version            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.ovs_bridge             = br-int {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.physnets               = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.region_name            = RegionOne {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.service_metadata_proxy = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.service_name           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.service_type           = network {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.split_loggers          = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.status_code_retries    = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.status_code_retry_delay = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.timeout                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] neutron.version                = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] notifications.bdms_in_notifications = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] notifications.default_level    = INFO {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] notifications.notification_format = unversioned {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] notifications.notify_on_state_change = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] pci.alias                      = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] pci.device_spec                = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] pci.report_in_placement        = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.auth_section         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.auth_type            = password {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.cafile               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.certfile             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.collect_timing       = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.connect_retries      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.connect_retry_delay  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.default_domain_id    = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.default_domain_name  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.domain_id            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.domain_name          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.endpoint_override    = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.insecure             = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.keyfile              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.max_version          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.min_version          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.password             = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.project_domain_id    = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.project_domain_name  = Default {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.project_id           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.project_name         = service {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.region_name          = RegionOne {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.service_name         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.service_type         = placement {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.split_loggers        = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.status_code_retries  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.status_code_retry_delay = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.system_scope         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.timeout              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.trust_id             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.user_domain_id       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.user_domain_name     = Default {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.user_id              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.username             = placement {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] placement.version              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.cores                    = 20 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.count_usage_from_placement = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.injected_file_content_bytes = 10240 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.injected_file_path_length = 255 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.injected_files           = 5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.instances                = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.key_pairs                = 100 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.metadata_items           = 128 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.ram                      = 51200 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.recheck_quota            = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.server_group_members     = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] quota.server_groups            = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] rdp.enabled                    = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.image_metadata_prefilter = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.max_attempts         = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.max_placement_results = 1000 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] scheduler.workers              = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.host_subset_size = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.isolated_hosts = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.isolated_images = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.pci_in_placement = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.track_instance_changes = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] metrics.required               = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] metrics.weight_multiplier      = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] metrics.weight_setting         = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] serial_console.enabled         = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] serial_console.port_range      = 10000:20000 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] serial_console.serialproxy_port = 6083 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.auth_section      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.auth_type         = password {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.cafile            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.certfile          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.collect_timing    = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.insecure          = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.keyfile           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.send_service_user_token = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.split_loggers     = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] service_user.timeout           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.agent_enabled            = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.enabled                  = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.html5proxy_port          = 6082 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.image_compression        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.jpeg_compression         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.playback_compression     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.server_listen            = 127.0.0.1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.streaming_mode           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] spice.zlib_compression         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] upgrade_levels.baseapi         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] upgrade_levels.compute         = auto {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] upgrade_levels.conductor       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] upgrade_levels.scheduler       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vendordata_dynamic_auth.cafile = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vendordata_dynamic_auth.certfile = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vendordata_dynamic_auth.insecure = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vendordata_dynamic_auth.timeout = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.api_retry_count         = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.ca_file                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.cache_prefix            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.cluster_name            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.connection_pool_size    = 10 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.console_delay_seconds   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.datastore_regex         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.host_ip                 = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.host_password           = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.host_port               = 443 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.host_username           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.insecure                = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.integration_bridge      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.maximum_objects         = 100 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.pbm_default_policy      = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.pbm_enabled             = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.pbm_wsdl_location       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.serial_port_proxy_uri   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.serial_port_service_uri = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.task_poll_interval      = 0.5 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.use_linked_clone        = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.vnc_keymap              = en-us {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.vnc_port                = 5900 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vmware.vnc_port_total          = 10000 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.auth_schemes               = ['none'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.enabled                    = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.novncproxy_port            = 6080 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.vencrypt_ca_certs          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.vencrypt_client_cert       = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vnc.vencrypt_client_key        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.disable_rootwrap   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.enable_numa_live_migration = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.libvirt_disable_apic = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.client_socket_timeout     = 900 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.default_pool_size         = 1000 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.keep_alive                = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.max_header_line           = 16384 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.ssl_ca_file               = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.ssl_cert_file             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.ssl_key_file              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.tcp_keepidle              = 600 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] zvm.ca_file                    = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] zvm.cloud_connector_url        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] zvm.reachable_timeout          = 300 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.enforce_new_defaults = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.enforce_scope      = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.policy_default_rule = default {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.connection_string     = messaging:// {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.enabled               = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.es_doc_type           = notification {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.es_scroll_size        = 10000 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.es_scroll_time        = 2m {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.filter_error_trace    = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.hmac_keys             = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.sentinel_service_name = mymaster {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.socket_timeout        = 0.1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.trace_requests        = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler.trace_sqlalchemy      = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler_jaeger.process_tags   = {} {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler_jaeger.service_name_prefix = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] profiler_otlp.service_name_prefix = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] remote_debug.host              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] remote_debug.port              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_notifications.retry = -1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.auth_section        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.auth_type           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.cafile              = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.certfile            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.collect_timing      = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.connect_retries     = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.connect_retry_delay = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.endpoint_id         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.endpoint_override   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.insecure            = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.keyfile             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.max_version         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.min_version         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.region_name         = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.service_name        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.service_type        = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.split_loggers       = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.status_code_retries = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.status_code_retry_delay = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.timeout             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.valid_interfaces    = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_limit.version             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_reports.file_event_handler = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] oslo_reports.log_dir           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_ovs_privileged.group  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] vif_plug_ovs_privileged.user   = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_ovs.isolate_vif         = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] os_brick.lock_path             = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] privsep_osbrick.capabilities   = [21] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] privsep_osbrick.group          = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] privsep_osbrick.helper_command = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] privsep_osbrick.user           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] nova_sys_admin.group           = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] nova_sys_admin.helper_command  = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] nova_sys_admin.user            = None {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG oslo_service.service [None req-3b3b4830-ae43-44ab-bcdf-93f90657a143 None None] ******************************************************************************** {{(pid=74963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 30 08:01:50 user nova-compute[74963]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 30 08:01:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Connecting to libvirt: qemu:///system {{(pid=74963) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f624d206350> {{(pid=74963) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 30 08:01:50 user nova-compute[74963]: libvirt:  error : internal error: could not initialize domain event timer
Nov 30 08:01:50 user nova-compute[74963]: WARNING nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 30 08:01:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f624d206350> {{(pid=74963) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Starting native event thread {{(pid=74963) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Starting green dispatch thread {{(pid=74963) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 30 08:01:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Starting connection event dispatch thread {{(pid=74963) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 30 08:01:50 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Connection event '1' reason 'None'
Nov 30 08:01:50 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 08:01:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.mount [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Initialising _HostMountState generation 0 {{(pid=74963) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 30 08:01:57 user nova-compute[74963]: INFO nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt host capabilities <capabilities>
Nov 30 08:01:57 user nova-compute[74963]:   <host>
Nov 30 08:01:57 user nova-compute[74963]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 30 08:01:57 user nova-compute[74963]:     <cpu>
Nov 30 08:01:57 user nova-compute[74963]:       <arch>x86_64</arch>
Nov 30 08:01:57 user nova-compute[74963]:       <model>IvyBridge-IBRS</model>
Nov 30 08:01:57 user nova-compute[74963]:       <vendor>Intel</vendor>
Nov 30 08:01:57 user nova-compute[74963]:       <microcode version='1070'/>
Nov 30 08:01:57 user nova-compute[74963]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 30 08:01:57 user nova-compute[74963]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='ss'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='vmx'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='pcid'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='osxsave'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='hypervisor'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='arat'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='tsc_adjust'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='md-clear'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='stibp'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='arch-capabilities'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='ssbd'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='invtsc'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='rsba'/>
Nov 30 08:01:57 user nova-compute[74963]:       <feature name='skip-l1dfl-vmentry'/>
Nov 30 08:01:57 user nova-compute[74963]:       <pages unit='KiB' size='4'/>
Nov 30 08:01:57 user nova-compute[74963]:       <pages unit='KiB' size='2048'/>
Nov 30 08:01:57 user nova-compute[74963]:     </cpu>
Nov 30 08:01:57 user nova-compute[74963]:     <power_management>
Nov 30 08:01:57 user nova-compute[74963]:       <suspend_mem/>
Nov 30 08:01:57 user nova-compute[74963]:       <suspend_disk/>
Nov 30 08:01:57 user nova-compute[74963]:       <suspend_hybrid/>
Nov 30 08:01:57 user nova-compute[74963]:     </power_management>
Nov 30 08:01:57 user nova-compute[74963]:     <iommu support='no'/>
Nov 30 08:01:57 user nova-compute[74963]:     <migration_features>
Nov 30 08:01:57 user nova-compute[74963]:       <live/>
Nov 30 08:01:57 user nova-compute[74963]:       <uri_transports>
Nov 30 08:01:57 user nova-compute[74963]:         <uri_transport>tcp</uri_transport>
Nov 30 08:01:57 user nova-compute[74963]:         <uri_transport>rdma</uri_transport>
Nov 30 08:01:57 user nova-compute[74963]:       </uri_transports>
Nov 30 08:01:57 user nova-compute[74963]:     </migration_features>
Nov 30 08:01:57 user nova-compute[74963]:     <topology>
Nov 30 08:01:57 user nova-compute[74963]:       <cells num='2'>
Nov 30 08:01:57 user nova-compute[74963]:         <cell id='0'>
Nov 30 08:01:57 user nova-compute[74963]:           <memory unit='KiB'>8140616</memory>
Nov 30 08:01:57 user nova-compute[74963]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 30 08:01:57 user nova-compute[74963]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 08:01:57 user nova-compute[74963]:           <distances>
Nov 30 08:01:57 user nova-compute[74963]:             <sibling id='0' value='10'/>
Nov 30 08:01:57 user nova-compute[74963]:             <sibling id='1' value='20'/>
Nov 30 08:01:57 user nova-compute[74963]:           </distances>
Nov 30 08:01:57 user nova-compute[74963]:           <cpus num='6'>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 30 08:01:57 user nova-compute[74963]:           </cpus>
Nov 30 08:01:57 user nova-compute[74963]:         </cell>
Nov 30 08:01:57 user nova-compute[74963]:         <cell id='1'>
Nov 30 08:01:57 user nova-compute[74963]:           <memory unit='KiB'>8255100</memory>
Nov 30 08:01:57 user nova-compute[74963]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 30 08:01:57 user nova-compute[74963]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 08:01:57 user nova-compute[74963]:           <distances>
Nov 30 08:01:57 user nova-compute[74963]:             <sibling id='0' value='20'/>
Nov 30 08:01:57 user nova-compute[74963]:             <sibling id='1' value='10'/>
Nov 30 08:01:57 user nova-compute[74963]:           </distances>
Nov 30 08:01:57 user nova-compute[74963]:           <cpus num='6'>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 30 08:01:57 user nova-compute[74963]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 30 08:01:57 user nova-compute[74963]:           </cpus>
Nov 30 08:01:57 user nova-compute[74963]:         </cell>
Nov 30 08:01:57 user nova-compute[74963]:       </cells>
Nov 30 08:01:57 user nova-compute[74963]:     </topology>
Nov 30 08:01:57 user nova-compute[74963]:     <cache>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 30 08:01:57 user nova-compute[74963]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 30 08:01:57 user nova-compute[74963]:     </cache>
Nov 30 08:01:57 user nova-compute[74963]:     <secmodel>
Nov 30 08:01:57 user nova-compute[74963]:       <model>apparmor</model>
Nov 30 08:01:57 user nova-compute[74963]:       <doi>0</doi>
Nov 30 08:01:57 user nova-compute[74963]:     </secmodel>
Nov 30 08:01:57 user nova-compute[74963]:     <secmodel>
Nov 30 08:01:58 user nova-compute[74963]:       <model>dac</model>
Nov 30 08:01:58 user nova-compute[74963]:       <doi>0</doi>
Nov 30 08:01:58 user nova-compute[74963]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 30 08:01:58 user nova-compute[74963]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 30 08:01:58 user nova-compute[74963]:     </secmodel>
Nov 30 08:01:58 user nova-compute[74963]:   </host>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='alpha'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>clipper</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='armv6l'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>spitz</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>nuri</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>kzm</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sx1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>z2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>tosa</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>n810</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>n800</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>terrier</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>midway</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>microbit</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>verdex</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>highbank</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>akita</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>connex</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>collie</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='armv7l'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>spitz</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>nuri</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>kzm</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sx1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>z2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>tosa</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>n810</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>n800</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>terrier</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>midway</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>microbit</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>verdex</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>highbank</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>akita</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>connex</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>collie</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='aarch64'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>spitz</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>nuri</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>kzm</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sx1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>z2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>tosa</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>n810</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>n800</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>terrier</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>midway</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>microbit</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>verdex</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>raspi3b</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>highbank</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>akita</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>connex</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>collie</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <acpi default='on' toggle='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='cris'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='i686'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>isapc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>microvm</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='kvm'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <pae/>
Nov 30 08:01:58 user nova-compute[74963]:       <nonpae/>
Nov 30 08:01:58 user nova-compute[74963]:       <acpi default='on' toggle='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:       <apic default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='m68k'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>an5206</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>q800</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>next-cube</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='microblaze'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='microblazeel'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='mips'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='16'>malta</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='mipsel'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='16'>malta</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='mips64'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='16'>malta</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>pica61</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>magnum</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='mips64el'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='16'>malta</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>pica61</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>magnum</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='16'>boston</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='ppc'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mac99</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>40p</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>taihu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='ppc64'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>taihu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>40p</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mac99</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='ppc64le'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>taihu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>40p</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>mac99</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='riscv32'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='8'>spike</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>opentitan</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='8'>virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='riscv64'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='8'>spike</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>shakti_c</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='8'>virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='s390x'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='sh4'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>shix</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>r2d</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='sh4eb'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>shix</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>r2d</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='sparc'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>SS-5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>SS-20</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>LX</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>SS-4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>SS-10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>Voyager</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='sparc64'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sun4u</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>niagara</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>sun4v</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='x86_64'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>64</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='1'>isapc</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>microvm</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='kvm'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <acpi default='on' toggle='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:       <apic default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='xtensa'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>sim</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>kc705</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>ml605</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>lx200</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>lx60</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]:   <guest>
Nov 30 08:01:58 user nova-compute[74963]:     <os_type>hvm</os_type>
Nov 30 08:01:58 user nova-compute[74963]:     <arch name='xtensaeb'>
Nov 30 08:01:58 user nova-compute[74963]:       <wordsize>32</wordsize>
Nov 30 08:01:58 user nova-compute[74963]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='4'>sim</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>kc705</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>ml605</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>virt</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>lx200</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>lx60</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 08:01:58 user nova-compute[74963]:       <domain type='qemu'/>
Nov 30 08:01:58 user nova-compute[74963]:     </arch>
Nov 30 08:01:58 user nova-compute[74963]:     <features>
Nov 30 08:01:58 user nova-compute[74963]:       <cpuselection/>
Nov 30 08:01:58 user nova-compute[74963]:       <deviceboot/>
Nov 30 08:01:58 user nova-compute[74963]:       <disksnapshot default='on' toggle='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     </features>
Nov 30 08:01:58 user nova-compute[74963]:   </guest>
Nov 30 08:01:58 user nova-compute[74963]: </capabilities>
Nov 30 08:01:58 user nova-compute[74963]: 
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 30 08:01:58 user nova-compute[74963]: <domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 08:01:58 user nova-compute[74963]:   <domain>kvm</domain>
Nov 30 08:01:58 user nova-compute[74963]:   <machine>pc-q35-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:   <arch>i686</arch>
Nov 30 08:01:58 user nova-compute[74963]:   <vcpu max='288'/>
Nov 30 08:01:58 user nova-compute[74963]:   <iothreads supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:   <os supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='firmware'/>
Nov 30 08:01:58 user nova-compute[74963]:     <loader supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>rom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pflash</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='readonly'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='secure'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </loader>
Nov 30 08:01:58 user nova-compute[74963]:   </os>
Nov 30 08:01:58 user nova-compute[74963]:   <cpu>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-passthrough' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='hostPassthroughMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='maximum' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='maximumMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-model' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <vendor>Intel</vendor>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ss'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='vmx'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pcid'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='hypervisor'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arat'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='umip'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='md-clear'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibpb'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibrs'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='erms'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='lm'/>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='custom' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>qemu64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>qemu32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>phenom</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>n270</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>kvm64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>coreduo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>core2duo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>athlon</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Westmere</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Snowridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Penryn</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G5</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G4</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G1</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Nehalem</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Rome</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Milan</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Dhyana</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cooperlake</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Conroe</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>486</model>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:   </cpu>
Nov 30 08:01:58 user nova-compute[74963]:   <memoryBacking supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='sourceType'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>file</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>anonymous</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>memfd</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:   </memoryBacking>
Nov 30 08:01:58 user nova-compute[74963]:   <devices>
Nov 30 08:01:58 user nova-compute[74963]:     <disk supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='diskDevice'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>disk</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cdrom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>floppy</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>lun</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='bus'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>fdc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sata</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </disk>
Nov 30 08:01:58 user nova-compute[74963]:     <graphics supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sdl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vnc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>spice</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egl-headless</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </graphics>
Nov 30 08:01:58 user nova-compute[74963]:     <video supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='modelType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cirrus</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vmvga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>qxl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>none</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>bochs</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ramfb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </video>
Nov 30 08:01:58 user nova-compute[74963]:     <hostdev supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='mode'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>subsystem</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='startupPolicy'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>default</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>mandatory</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>requisite</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>optional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='subsysType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pci</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='capsType'/>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='pciBackend'/>
Nov 30 08:01:58 user nova-compute[74963]:     </hostdev>
Nov 30 08:01:58 user nova-compute[74963]:     <rng supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>random</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egd</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>builtin</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </rng>
Nov 30 08:01:58 user nova-compute[74963]:     <filesystem supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='driverType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>path</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>handle</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtiofs</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </filesystem>
Nov 30 08:01:58 user nova-compute[74963]:     <tpm supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-tis</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-crb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>passthrough</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>emulator</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </tpm>
Nov 30 08:01:58 user nova-compute[74963]:   </devices>
Nov 30 08:01:58 user nova-compute[74963]:   <features>
Nov 30 08:01:58 user nova-compute[74963]:     <gic supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     <vmcoreinfo supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <genid supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backingStoreInput supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backup supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <sev supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:   </features>
Nov 30 08:01:58 user nova-compute[74963]: </domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:  {{(pid=74963) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 30 08:01:58 user nova-compute[74963]: <domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 08:01:58 user nova-compute[74963]:   <domain>kvm</domain>
Nov 30 08:01:58 user nova-compute[74963]:   <machine>pc-i440fx-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:   <arch>i686</arch>
Nov 30 08:01:58 user nova-compute[74963]:   <vcpu max='255'/>
Nov 30 08:01:58 user nova-compute[74963]:   <iothreads supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:   <os supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='firmware'/>
Nov 30 08:01:58 user nova-compute[74963]:     <loader supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>rom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pflash</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='readonly'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='secure'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </loader>
Nov 30 08:01:58 user nova-compute[74963]:   </os>
Nov 30 08:01:58 user nova-compute[74963]:   <cpu>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-passthrough' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='hostPassthroughMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='maximum' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='maximumMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-model' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <vendor>Intel</vendor>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ss'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='vmx'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pcid'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='hypervisor'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arat'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='umip'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='md-clear'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibpb'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibrs'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='erms'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='lm'/>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='custom' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>qemu64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>qemu32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>phenom</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>n270</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>kvm64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>coreduo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>core2duo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>athlon</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Westmere</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Snowridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Penryn</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G5</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G4</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G1</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Nehalem</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Rome</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Milan</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Dhyana</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cooperlake</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Conroe</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>486</model>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:   </cpu>
Nov 30 08:01:58 user nova-compute[74963]:   <memoryBacking supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='sourceType'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>file</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>anonymous</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>memfd</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:   </memoryBacking>
Nov 30 08:01:58 user nova-compute[74963]:   <devices>
Nov 30 08:01:58 user nova-compute[74963]:     <disk supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='diskDevice'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>disk</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cdrom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>floppy</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>lun</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='bus'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ide</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>fdc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sata</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </disk>
Nov 30 08:01:58 user nova-compute[74963]:     <graphics supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sdl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vnc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>spice</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egl-headless</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </graphics>
Nov 30 08:01:58 user nova-compute[74963]:     <video supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='modelType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cirrus</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vmvga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>qxl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>none</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>bochs</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ramfb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </video>
Nov 30 08:01:58 user nova-compute[74963]:     <hostdev supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='mode'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>subsystem</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='startupPolicy'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>default</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>mandatory</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>requisite</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>optional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='subsysType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pci</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='capsType'/>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='pciBackend'/>
Nov 30 08:01:58 user nova-compute[74963]:     </hostdev>
Nov 30 08:01:58 user nova-compute[74963]:     <rng supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>random</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egd</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>builtin</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </rng>
Nov 30 08:01:58 user nova-compute[74963]:     <filesystem supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='driverType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>path</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>handle</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtiofs</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </filesystem>
Nov 30 08:01:58 user nova-compute[74963]:     <tpm supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-tis</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-crb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>passthrough</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>emulator</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </tpm>
Nov 30 08:01:58 user nova-compute[74963]:   </devices>
Nov 30 08:01:58 user nova-compute[74963]:   <features>
Nov 30 08:01:58 user nova-compute[74963]:     <gic supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     <vmcoreinfo supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <genid supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backingStoreInput supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backup supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <sev supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:   </features>
Nov 30 08:01:58 user nova-compute[74963]: </domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:  {{(pid=74963) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 30 08:01:58 user nova-compute[74963]: <domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 08:01:58 user nova-compute[74963]:   <domain>kvm</domain>
Nov 30 08:01:58 user nova-compute[74963]:   <machine>pc-i440fx-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:   <arch>i686</arch>
Nov 30 08:01:58 user nova-compute[74963]:   <vcpu max='255'/>
Nov 30 08:01:58 user nova-compute[74963]:   <iothreads supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:   <os supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='firmware'/>
Nov 30 08:01:58 user nova-compute[74963]:     <loader supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>rom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pflash</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='readonly'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='secure'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </loader>
Nov 30 08:01:58 user nova-compute[74963]:   </os>
Nov 30 08:01:58 user nova-compute[74963]:   <cpu>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-passthrough' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='hostPassthroughMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='maximum' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='maximumMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-model' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <vendor>Intel</vendor>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ss'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='vmx'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pcid'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='hypervisor'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arat'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='umip'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='md-clear'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibpb'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibrs'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='erms'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='lm'/>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='custom' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>qemu64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>qemu32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>phenom</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>n270</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>kvm64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>coreduo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>core2duo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>athlon</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Westmere</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Snowridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Penryn</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G5</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G4</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G1</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Nehalem</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Rome</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Milan</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Dhyana</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cooperlake</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Conroe</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>486</model>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:   </cpu>
Nov 30 08:01:58 user nova-compute[74963]:   <memoryBacking supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='sourceType'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>file</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>anonymous</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>memfd</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:   </memoryBacking>
Nov 30 08:01:58 user nova-compute[74963]:   <devices>
Nov 30 08:01:58 user nova-compute[74963]:     <disk supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='diskDevice'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>disk</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cdrom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>floppy</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>lun</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='bus'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ide</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>fdc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sata</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </disk>
Nov 30 08:01:58 user nova-compute[74963]:     <graphics supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sdl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vnc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>spice</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egl-headless</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </graphics>
Nov 30 08:01:58 user nova-compute[74963]:     <video supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='modelType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cirrus</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vmvga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>qxl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>none</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>bochs</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ramfb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </video>
Nov 30 08:01:58 user nova-compute[74963]:     <hostdev supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='mode'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>subsystem</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='startupPolicy'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>default</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>mandatory</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>requisite</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>optional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='subsysType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pci</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='capsType'/>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='pciBackend'/>
Nov 30 08:01:58 user nova-compute[74963]:     </hostdev>
Nov 30 08:01:58 user nova-compute[74963]:     <rng supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>random</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egd</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>builtin</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </rng>
Nov 30 08:01:58 user nova-compute[74963]:     <filesystem supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='driverType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>path</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>handle</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtiofs</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </filesystem>
Nov 30 08:01:58 user nova-compute[74963]:     <tpm supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-tis</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-crb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>passthrough</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>emulator</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </tpm>
Nov 30 08:01:58 user nova-compute[74963]:   </devices>
Nov 30 08:01:58 user nova-compute[74963]:   <features>
Nov 30 08:01:58 user nova-compute[74963]:     <gic supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     <vmcoreinfo supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <genid supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backingStoreInput supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backup supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <sev supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:   </features>
Nov 30 08:01:58 user nova-compute[74963]: </domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:  {{(pid=74963) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 30 08:01:58 user nova-compute[74963]: <domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 08:01:58 user nova-compute[74963]:   <domain>kvm</domain>
Nov 30 08:01:58 user nova-compute[74963]:   <machine>pc-q35-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:   <arch>i686</arch>
Nov 30 08:01:58 user nova-compute[74963]:   <vcpu max='288'/>
Nov 30 08:01:58 user nova-compute[74963]:   <iothreads supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:   <os supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='firmware'/>
Nov 30 08:01:58 user nova-compute[74963]:     <loader supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>rom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pflash</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='readonly'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='secure'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </loader>
Nov 30 08:01:58 user nova-compute[74963]:   </os>
Nov 30 08:01:58 user nova-compute[74963]:   <cpu>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-passthrough' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='hostPassthroughMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='maximum' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='maximumMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-model' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <vendor>Intel</vendor>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ss'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='vmx'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pcid'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='hypervisor'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arat'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='umip'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='md-clear'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibpb'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibrs'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='erms'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='lm'/>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='custom' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>qemu64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>qemu32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>phenom</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>n270</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>kvm64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>coreduo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>core2duo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>athlon</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Westmere</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Snowridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Penryn</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G5</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G4</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G1</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Nehalem</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Rome</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Milan</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Dhyana</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cooperlake</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Conroe</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>486</model>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:   </cpu>
Nov 30 08:01:58 user nova-compute[74963]:   <memoryBacking supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='sourceType'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>file</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>anonymous</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>memfd</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:   </memoryBacking>
Nov 30 08:01:58 user nova-compute[74963]:   <devices>
Nov 30 08:01:58 user nova-compute[74963]:     <disk supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='diskDevice'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>disk</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cdrom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>floppy</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>lun</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='bus'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>fdc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sata</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </disk>
Nov 30 08:01:58 user nova-compute[74963]:     <graphics supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sdl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vnc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>spice</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egl-headless</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </graphics>
Nov 30 08:01:58 user nova-compute[74963]:     <video supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='modelType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cirrus</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vmvga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>qxl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>none</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>bochs</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ramfb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </video>
Nov 30 08:01:58 user nova-compute[74963]:     <hostdev supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='mode'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>subsystem</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='startupPolicy'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>default</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>mandatory</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>requisite</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>optional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='subsysType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pci</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='capsType'/>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='pciBackend'/>
Nov 30 08:01:58 user nova-compute[74963]:     </hostdev>
Nov 30 08:01:58 user nova-compute[74963]:     <rng supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>random</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egd</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>builtin</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </rng>
Nov 30 08:01:58 user nova-compute[74963]:     <filesystem supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='driverType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>path</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>handle</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtiofs</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </filesystem>
Nov 30 08:01:58 user nova-compute[74963]:     <tpm supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-tis</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-crb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>passthrough</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>emulator</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </tpm>
Nov 30 08:01:58 user nova-compute[74963]:   </devices>
Nov 30 08:01:58 user nova-compute[74963]:   <features>
Nov 30 08:01:58 user nova-compute[74963]:     <gic supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     <vmcoreinfo supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <genid supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backingStoreInput supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backup supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <sev supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:   </features>
Nov 30 08:01:58 user nova-compute[74963]: </domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:  {{(pid=74963) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 30 08:01:58 user nova-compute[74963]: <domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 08:01:58 user nova-compute[74963]:   <domain>kvm</domain>
Nov 30 08:01:58 user nova-compute[74963]:   <machine>pc-q35-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:   <arch>x86_64</arch>
Nov 30 08:01:58 user nova-compute[74963]:   <vcpu max='288'/>
Nov 30 08:01:58 user nova-compute[74963]:   <iothreads supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:   <os supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='firmware'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>efi</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:     <loader supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>rom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pflash</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='readonly'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='secure'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </loader>
Nov 30 08:01:58 user nova-compute[74963]:   </os>
Nov 30 08:01:58 user nova-compute[74963]:   <cpu>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-passthrough' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='hostPassthroughMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='maximum' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='maximumMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-model' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <vendor>Intel</vendor>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ss'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='vmx'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pcid'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='hypervisor'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arat'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='umip'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='md-clear'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='invtsc'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibpb'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibrs'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='rsba'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='erms'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='custom' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>qemu64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>qemu32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>phenom</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>n270</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>coreduo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>core2duo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>athlon</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Westmere</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Snowridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Penryn</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G5</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G4</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Opteron_G1</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Nehalem</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Rome</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Milan</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Dhyana</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cooperlake</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Conroe</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>486</model>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:   </cpu>
Nov 30 08:01:58 user nova-compute[74963]:   <memoryBacking supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='sourceType'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>file</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>anonymous</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>memfd</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:   </memoryBacking>
Nov 30 08:01:58 user nova-compute[74963]:   <devices>
Nov 30 08:01:58 user nova-compute[74963]:     <disk supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='diskDevice'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>disk</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cdrom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>floppy</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>lun</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='bus'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>fdc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sata</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </disk>
Nov 30 08:01:58 user nova-compute[74963]:     <graphics supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sdl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vnc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>spice</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egl-headless</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </graphics>
Nov 30 08:01:58 user nova-compute[74963]:     <video supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='modelType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cirrus</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vmvga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>qxl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>none</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>bochs</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ramfb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </video>
Nov 30 08:01:58 user nova-compute[74963]:     <hostdev supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='mode'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>subsystem</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='startupPolicy'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>default</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>mandatory</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>requisite</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>optional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='subsysType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pci</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='capsType'/>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='pciBackend'/>
Nov 30 08:01:58 user nova-compute[74963]:     </hostdev>
Nov 30 08:01:58 user nova-compute[74963]:     <rng supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>random</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egd</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>builtin</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </rng>
Nov 30 08:01:58 user nova-compute[74963]:     <filesystem supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='driverType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>path</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>handle</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtiofs</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </filesystem>
Nov 30 08:01:58 user nova-compute[74963]:     <tpm supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-tis</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-crb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>passthrough</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>emulator</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </tpm>
Nov 30 08:01:58 user nova-compute[74963]:   </devices>
Nov 30 08:01:58 user nova-compute[74963]:   <features>
Nov 30 08:01:58 user nova-compute[74963]:     <gic supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     <vmcoreinfo supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <genid supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backingStoreInput supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backup supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <sev supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:   </features>
Nov 30 08:01:58 user nova-compute[74963]: </domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:  {{(pid=74963) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 30 08:01:58 user nova-compute[74963]: <domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 08:01:58 user nova-compute[74963]:   <domain>kvm</domain>
Nov 30 08:01:58 user nova-compute[74963]:   <machine>pc-i440fx-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:   <arch>x86_64</arch>
Nov 30 08:01:58 user nova-compute[74963]:   <vcpu max='255'/>
Nov 30 08:01:58 user nova-compute[74963]:   <iothreads supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:   <os supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='firmware'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>efi</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:     <loader supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>rom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pflash</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='readonly'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='secure'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </loader>
Nov 30 08:01:58 user nova-compute[74963]:   </os>
Nov 30 08:01:58 user nova-compute[74963]:   <cpu>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-passthrough' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='hostPassthroughMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='maximum' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='maximumMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-model' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <vendor>Intel</vendor>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ss'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='vmx'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pcid'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='hypervisor'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arat'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='umip'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='md-clear'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='invtsc'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibpb'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibrs'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='rsba'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='erms'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='custom' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>qemu64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>qemu32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>phenom</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>n270</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>coreduo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>core2duo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>athlon</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Westmere</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Snowridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Penryn</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G5</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G4</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Opteron_G1</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Nehalem</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Rome</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Milan</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Dhyana</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cooperlake</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Conroe</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>486</model>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:   </cpu>
Nov 30 08:01:58 user nova-compute[74963]:   <memoryBacking supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='sourceType'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>file</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>anonymous</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>memfd</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:   </memoryBacking>
Nov 30 08:01:58 user nova-compute[74963]:   <devices>
Nov 30 08:01:58 user nova-compute[74963]:     <disk supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='diskDevice'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>disk</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cdrom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>floppy</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>lun</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='bus'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ide</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>fdc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sata</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </disk>
Nov 30 08:01:58 user nova-compute[74963]:     <graphics supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sdl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vnc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>spice</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egl-headless</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </graphics>
Nov 30 08:01:58 user nova-compute[74963]:     <video supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='modelType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cirrus</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vmvga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>qxl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>none</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>bochs</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ramfb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </video>
Nov 30 08:01:58 user nova-compute[74963]:     <hostdev supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='mode'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>subsystem</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='startupPolicy'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>default</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>mandatory</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>requisite</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>optional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='subsysType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pci</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='capsType'/>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='pciBackend'/>
Nov 30 08:01:58 user nova-compute[74963]:     </hostdev>
Nov 30 08:01:58 user nova-compute[74963]:     <rng supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>random</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egd</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>builtin</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </rng>
Nov 30 08:01:58 user nova-compute[74963]:     <filesystem supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='driverType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>path</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>handle</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtiofs</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </filesystem>
Nov 30 08:01:58 user nova-compute[74963]:     <tpm supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-tis</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-crb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>passthrough</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>emulator</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </tpm>
Nov 30 08:01:58 user nova-compute[74963]:   </devices>
Nov 30 08:01:58 user nova-compute[74963]:   <features>
Nov 30 08:01:58 user nova-compute[74963]:     <gic supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     <vmcoreinfo supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <genid supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backingStoreInput supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backup supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <sev supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:   </features>
Nov 30 08:01:58 user nova-compute[74963]: </domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:  {{(pid=74963) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 30 08:01:58 user nova-compute[74963]: <domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 08:01:58 user nova-compute[74963]:   <domain>kvm</domain>
Nov 30 08:01:58 user nova-compute[74963]:   <machine>pc-i440fx-jammy</machine>
Nov 30 08:01:58 user nova-compute[74963]:   <arch>x86_64</arch>
Nov 30 08:01:58 user nova-compute[74963]:   <vcpu max='255'/>
Nov 30 08:01:58 user nova-compute[74963]:   <iothreads supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:   <os supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='firmware'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>efi</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:     <loader supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>rom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pflash</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='readonly'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='secure'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </loader>
Nov 30 08:01:58 user nova-compute[74963]:   </os>
Nov 30 08:01:58 user nova-compute[74963]:   <cpu>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-passthrough' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='hostPassthroughMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='maximum' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='maximumMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-model' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <vendor>Intel</vendor>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ss'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='vmx'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pcid'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='hypervisor'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arat'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='umip'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='md-clear'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='invtsc'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibpb'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibrs'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='rsba'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='erms'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='custom' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>qemu64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>qemu32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>phenom</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>n270</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>coreduo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>core2duo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>athlon</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Westmere</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Snowridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Penryn</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G5</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G4</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Opteron_G1</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Nehalem</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Rome</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Milan</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Dhyana</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cooperlake</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Conroe</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>486</model>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:   </cpu>
Nov 30 08:01:58 user nova-compute[74963]:   <memoryBacking supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='sourceType'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>file</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>anonymous</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>memfd</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:   </memoryBacking>
Nov 30 08:01:58 user nova-compute[74963]:   <devices>
Nov 30 08:01:58 user nova-compute[74963]:     <disk supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='diskDevice'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>disk</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cdrom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>floppy</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>lun</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='bus'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ide</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>fdc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sata</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </disk>
Nov 30 08:01:58 user nova-compute[74963]:     <graphics supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sdl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vnc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>spice</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egl-headless</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </graphics>
Nov 30 08:01:58 user nova-compute[74963]:     <video supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='modelType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cirrus</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vmvga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>qxl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>none</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>bochs</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ramfb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </video>
Nov 30 08:01:58 user nova-compute[74963]:     <hostdev supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='mode'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>subsystem</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='startupPolicy'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>default</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>mandatory</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>requisite</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>optional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='subsysType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pci</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='capsType'/>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='pciBackend'/>
Nov 30 08:01:58 user nova-compute[74963]:     </hostdev>
Nov 30 08:01:58 user nova-compute[74963]:     <rng supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>random</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egd</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>builtin</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </rng>
Nov 30 08:01:58 user nova-compute[74963]:     <filesystem supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='driverType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>path</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>handle</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtiofs</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </filesystem>
Nov 30 08:01:58 user nova-compute[74963]:     <tpm supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-tis</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-crb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>passthrough</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>emulator</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </tpm>
Nov 30 08:01:58 user nova-compute[74963]:   </devices>
Nov 30 08:01:58 user nova-compute[74963]:   <features>
Nov 30 08:01:58 user nova-compute[74963]:     <gic supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     <vmcoreinfo supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <genid supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backingStoreInput supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backup supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <sev supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:   </features>
Nov 30 08:01:58 user nova-compute[74963]: </domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:  {{(pid=74963) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 30 08:01:58 user nova-compute[74963]: <domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 08:01:58 user nova-compute[74963]:   <domain>kvm</domain>
Nov 30 08:01:58 user nova-compute[74963]:   <machine>pc-q35-6.2</machine>
Nov 30 08:01:58 user nova-compute[74963]:   <arch>x86_64</arch>
Nov 30 08:01:58 user nova-compute[74963]:   <vcpu max='288'/>
Nov 30 08:01:58 user nova-compute[74963]:   <iothreads supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:   <os supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='firmware'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>efi</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:     <loader supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>rom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pflash</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='readonly'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='secure'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>yes</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>no</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </loader>
Nov 30 08:01:58 user nova-compute[74963]:   </os>
Nov 30 08:01:58 user nova-compute[74963]:   <cpu>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-passthrough' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='hostPassthroughMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='maximum' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='maximumMigratable'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>on</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>off</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='host-model' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <vendor>Intel</vendor>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ss'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='vmx'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pcid'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='hypervisor'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arat'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='umip'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='md-clear'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='invtsc'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibpb'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='ibrs'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-stibp'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='rsba'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='erms'/>
Nov 30 08:01:58 user nova-compute[74963]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:     <mode name='custom' supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>qemu64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>qemu32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>phenom</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>pentium</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>n270</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm64</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>kvm32</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>coreduo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>core2duo</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>athlon</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Westmere</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Snowridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Skylake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>SandyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Penryn</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G5</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G4</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G3</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Opteron_G2</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Opteron_G1</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Nehalem</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>IvyBridge</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Icelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Haswell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Rome</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-Milan</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>EPYC</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Dhyana</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cooperlake</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>Conroe</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='no'>Broadwell</model>
Nov 30 08:01:58 user nova-compute[74963]:       <model usable='yes'>486</model>
Nov 30 08:01:58 user nova-compute[74963]:     </mode>
Nov 30 08:01:58 user nova-compute[74963]:   </cpu>
Nov 30 08:01:58 user nova-compute[74963]:   <memoryBacking supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:     <enum name='sourceType'>
Nov 30 08:01:58 user nova-compute[74963]:       <value>file</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>anonymous</value>
Nov 30 08:01:58 user nova-compute[74963]:       <value>memfd</value>
Nov 30 08:01:58 user nova-compute[74963]:     </enum>
Nov 30 08:01:58 user nova-compute[74963]:   </memoryBacking>
Nov 30 08:01:58 user nova-compute[74963]:   <devices>
Nov 30 08:01:58 user nova-compute[74963]:     <disk supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='diskDevice'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>disk</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cdrom</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>floppy</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>lun</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='bus'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>fdc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sata</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </disk>
Nov 30 08:01:58 user nova-compute[74963]:     <graphics supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='type'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>sdl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vnc</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>spice</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egl-headless</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </graphics>
Nov 30 08:01:58 user nova-compute[74963]:     <video supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='modelType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>cirrus</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>vmvga</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>qxl</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>none</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>bochs</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>ramfb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </video>
Nov 30 08:01:58 user nova-compute[74963]:     <hostdev supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='mode'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>subsystem</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='startupPolicy'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>default</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>mandatory</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>requisite</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>optional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='subsysType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>usb</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>pci</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>scsi</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='capsType'/>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='pciBackend'/>
Nov 30 08:01:58 user nova-compute[74963]:     </hostdev>
Nov 30 08:01:58 user nova-compute[74963]:     <rng supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtio-non-transitional</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>random</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>egd</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>builtin</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </rng>
Nov 30 08:01:58 user nova-compute[74963]:     <filesystem supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='driverType'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>path</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>handle</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>virtiofs</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </filesystem>
Nov 30 08:01:58 user nova-compute[74963]:     <tpm supported='yes'>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='model'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-tis</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>tpm-crb</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:       <enum name='backendModel'>
Nov 30 08:01:58 user nova-compute[74963]:         <value>passthrough</value>
Nov 30 08:01:58 user nova-compute[74963]:         <value>emulator</value>
Nov 30 08:01:58 user nova-compute[74963]:       </enum>
Nov 30 08:01:58 user nova-compute[74963]:     </tpm>
Nov 30 08:01:58 user nova-compute[74963]:   </devices>
Nov 30 08:01:58 user nova-compute[74963]:   <features>
Nov 30 08:01:58 user nova-compute[74963]:     <gic supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:     <vmcoreinfo supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <genid supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backingStoreInput supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <backup supported='yes'/>
Nov 30 08:01:58 user nova-compute[74963]:     <sev supported='no'/>
Nov 30 08:01:58 user nova-compute[74963]:   </features>
Nov 30 08:01:58 user nova-compute[74963]: </domainCapabilities>
Nov 30 08:01:58 user nova-compute[74963]:  {{(pid=74963) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74963) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74963) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Checking secure boot support for host arch (x86_64) {{(pid=74963) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 30 08:01:58 user nova-compute[74963]: INFO nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Secure Boot support detected
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] cpu compare xml: <cpu match="exact">
Nov 30 08:01:58 user nova-compute[74963]:   <model>Nehalem</model>
Nov 30 08:01:58 user nova-compute[74963]: </cpu>
Nov 30 08:01:58 user nova-compute[74963]:  {{(pid=74963) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 30 08:01:58 user nova-compute[74963]: INFO nova.virt.node [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Generated node identity 41961ac9-576a-4a02-a5e7-459f54657b3f
Nov 30 08:01:58 user nova-compute[74963]: INFO nova.virt.node [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Wrote node identity 41961ac9-576a-4a02-a5e7-459f54657b3f to /opt/stack/data/nova/compute_id
Nov 30 08:01:58 user nova-compute[74963]: WARNING nova.compute.manager [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Compute nodes ['41961ac9-576a-4a02-a5e7-459f54657b3f'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 30 08:01:58 user nova-compute[74963]: INFO nova.compute.manager [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 30 08:01:58 user nova-compute[74963]: WARNING nova.compute.manager [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 08:01:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:01:58 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:01:58 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Hypervisor/Node resource view: name=user free_ram=10933MB free_disk=26.207386016845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:01:58 user nova-compute[74963]: WARNING nova.compute.resource_tracker [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] No compute node record for user:41961ac9-576a-4a02-a5e7-459f54657b3f: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 41961ac9-576a-4a02-a5e7-459f54657b3f could not be found.
Nov 30 08:01:58 user nova-compute[74963]: INFO nova.compute.resource_tracker [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Compute node record created for user:user with uuid: 41961ac9-576a-4a02-a5e7-459f54657b3f
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:01:58 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:01:58 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] [req-eedde95f-4181-4fd3-9637-77af725cd1b0] Created resource provider record via placement API for resource provider with UUID 41961ac9-576a-4a02-a5e7-459f54657b3f and name user.
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74963) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 30 08:01:59 user nova-compute[74963]: INFO nova.virt.libvirt.host [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] kernel doesn't support AMD SEV
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Updating inventory in ProviderTree for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Libvirt baseline CPU <cpu>
Nov 30 08:01:59 user nova-compute[74963]:   <arch>x86_64</arch>
Nov 30 08:01:59 user nova-compute[74963]:   <model>Nehalem</model>
Nov 30 08:01:59 user nova-compute[74963]:   <vendor>Intel</vendor>
Nov 30 08:01:59 user nova-compute[74963]:   <topology sockets="6" cores="1" threads="1"/>
Nov 30 08:01:59 user nova-compute[74963]: </cpu>
Nov 30 08:01:59 user nova-compute[74963]:  {{(pid=74963) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Updated inventory for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Updating resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f generation from 0 to 1 during operation: update_inventory {{(pid=74963) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Updating inventory in ProviderTree for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Updating resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f generation from 1 to 2 during operation: update_traits {{(pid=74963) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.service [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Creating RPC server for service compute {{(pid=74963) start /opt/stack/nova/nova/service.py:182}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.service [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] Join ServiceGroup membership for this service compute {{(pid=74963) start /opt/stack/nova/nova/service.py:199}}
Nov 30 08:01:59 user nova-compute[74963]: DEBUG nova.servicegroup.drivers.db [None req-cd5bb8b1-9c4c-42ad-8141-ca939447dcd7 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74963) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 30 08:02:24 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:24 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Didn't find any instances for network info cache update. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:02:50 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:02:50 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=10361MB free_disk=26.111045837402344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:02:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:03:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:03:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:03:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:03:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:03:50 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:03:50 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:03:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=10269MB free_disk=26.176849365234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:03:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:03:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Didn't find any instances for network info cache update. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:51 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:52 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:52 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:52 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:03:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:04:50 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:04:50 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:04:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=10280MB free_disk=25.930118560791016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:04:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:04:51 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:04:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:04:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:04:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Didn't find any instances for network info cache update. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 08:04:51 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:04:52 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:04:52 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:04:53 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:04:53 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:04:53 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:04:54 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:04:54 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:05:51 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Didn't find any instances for network info cache update. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:05:52 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:05:52 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=9629MB free_disk=25.948760986328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:05:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:05:53 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:53 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:54 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:54 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:55 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:05:55 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:06:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:06:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:06:02 user nova-compute[74963]: INFO nova.compute.claims [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Claim successful on node user
Nov 30 08:06:02 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:06:02 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:06:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:06:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:06:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:06:02 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:06:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:06:03 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:06:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:06:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Creating image(s)
Nov 30 08:06:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "/opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "/opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "/opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520.part --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:04 user nova-compute[74963]: DEBUG nova.policy [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '709296ad4feb46a580f22f79a87233b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb3709ed7b39464eb736837ee9167d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:06:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520.part --force-share --output=json" returned: 0 in 0.246s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:04 user nova-compute[74963]: DEBUG nova.virt.images [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ea262e08-aaf0-444c-be1e-ba1d8691ac72 was qcow2, converting to raw {{(pid=74963) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 08:06:04 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:06:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520.part /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520.converted {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520.part /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520.converted" returned: 0 in 0.322s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520.converted --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.145s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:05 user nova-compute[74963]: INFO oslo.privsep.daemon [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0bnzh7bw/privsep.sock']
Nov 30 08:06:05 user sudo[84214]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0bnzh7bw/privsep.sock
Nov 30 08:06:05 user sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "68bcb314-8197-4fe6-b986-b2554c822545" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "68bcb314-8197-4fe6-b986-b2554c822545" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:06:05 user nova-compute[74963]: INFO nova.compute.claims [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Claim successful on node user
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "25afcf51-de30-4a53-bb6b-3e7037f5e386" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "12839e0a-b601-49f3-910e-fb41627ba2c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:06:06 user nova-compute[74963]: INFO nova.compute.claims [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Claim successful on node user
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.network.neutron [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:06:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.policy [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b110fcb508342509690b45e1854eb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce233bd757b64de4bd6f6abb3230da01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Successfully created port: 9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:06:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Creating image(s)
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "/opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "/opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "/opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.430s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:06:06 user nova-compute[74963]: INFO nova.compute.claims [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Claim successful on node user
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:06:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:06:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Creating image(s)
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "/opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "/opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "/opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:06:07 user sudo[84214]: pam_unix(sudo:session): session closed for user root
Nov 30 08:06:07 user nova-compute[74963]: INFO oslo.privsep.daemon [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Spawned new privsep daemon via rootwrap
Nov 30 08:06:07 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 08:06:07 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 08:06:07 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 30 08:06:07 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84219
Nov 30 08:06:07 user nova-compute[74963]: WARNING oslo_privsep.priv_context [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] privsep daemon already running
Nov 30 08:06:07 user nova-compute[74963]: WARNING oslo_privsep.priv_context [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] privsep daemon already running
Nov 30 08:06:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:06:07 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:06:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG nova.policy [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63de4ab983be439488dc30077810b5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e5b724c4d64e9f9900b7bad1c2a00f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:06:07 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Creating image(s)
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "/opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "/opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "/opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG nova.policy [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '275934c9efc348e3a8a116ee8298e88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '134571570f864b598a5b419156d7847e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.202s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.235s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.245s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk 1073741824" returned: 0 in 0.041s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.309s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Successfully created port: da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:06:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.218s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk 1073741824" returned: 0 in 0.047s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.598s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Cannot resize image /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Ensure instance console log exists: /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk 1073741824" returned: 0 in 0.061s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.774s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Cannot resize image /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Ensure instance console log exists: /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Successfully updated port: 9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquired lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk 1073741824" returned: 0 in 0.053s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Successfully created port: cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Cannot resize image /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Ensure instance console log exists: /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.238s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:06:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Cannot resize image /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Ensure instance console log exists: /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-41cbc3a8-d5fb-4066-938e-e0ba4b5f27d8 req-c6893a18-4b28-421a-a464-5f683aab64f4 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-changed-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-41cbc3a8-d5fb-4066-938e-e0ba4b5f27d8 req-c6893a18-4b28-421a-a464-5f683aab64f4 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Refreshing instance network info cache due to event network-changed-9f867ffa-aeb8-4693-bce5-c4e507fad1a2. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41cbc3a8-d5fb-4066-938e-e0ba4b5f27d8 req-c6893a18-4b28-421a-a464-5f683aab64f4 service nova] Acquiring lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Successfully created port: 98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Successfully updated port: da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquired lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-41518f92-3a16-4d05-aa9f-a5994f9b00f4 req-0ef2e40a-2acf-40de-8cc1-7f5355e71f8a service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received event network-changed-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-41518f92-3a16-4d05-aa9f-a5994f9b00f4 req-0ef2e40a-2acf-40de-8cc1-7f5355e71f8a service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Refreshing instance network info cache due to event network-changed-da46a6e7-40cb-41cf-93c3-b55ed9fff992. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:06:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41518f92-3a16-4d05-aa9f-a5994f9b00f4 req-0ef2e40a-2acf-40de-8cc1-7f5355e71f8a service nova] Acquiring lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Releasing lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance network_info: |[{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41cbc3a8-d5fb-4066-938e-e0ba4b5f27d8 req-c6893a18-4b28-421a-a464-5f683aab64f4 service nova] Acquired lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.neutron [req-41cbc3a8-d5fb-4066-938e-e0ba4b5f27d8 req-c6893a18-4b28-421a-a464-5f683aab64f4 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Refreshing network info cache for port 9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Start _get_guest_xml network_info=[{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:06:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1915210269',display_name='tempest-ServerActionsTestOtherB-server-1915210269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1915210269',id=1,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36ci9r8PQsZAIlncqo2lnhzQxOBqtCX/Nhuwzpg/1rHe+dDRDEWc3NXIhEOThN+3uJ2JkTtQ14Ec2v58DN2WowXRvVjxsTkVJ/eZYNznnLTsNFO26FNZYoSoo9gHV1uA==',key_name='tempest-keypair-1061087135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3709ed7b39464eb736837ee9167d04',ramdisk_id='',reservation_id='r-ij7puok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1961924021',owner_user_name='tempest-ServerActionsTestOtherB-1961924021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='709296ad4feb46a580f22f79a87233b4',uuid=3551893b-4a59-4e6a-a961-8ea6d671632e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converting VIF {"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lazy-loading 'pci_devices' on Instance uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:06:10 user nova-compute[74963]:   <uuid>3551893b-4a59-4e6a-a961-8ea6d671632e</uuid>
Nov 30 08:06:10 user nova-compute[74963]:   <name>instance-00000001</name>
Nov 30 08:06:10 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:06:10 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:06:10 user nova-compute[74963]:   <metadata>
Nov 30 08:06:10 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:06:10 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:name>tempest-ServerActionsTestOtherB-server-1915210269</nova:name>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:06:10</nova:creationTime>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:06:10 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:06:10 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:owner>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:user uuid="709296ad4feb46a580f22f79a87233b4">tempest-ServerActionsTestOtherB-1961924021-project-member</nova:user>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:project uuid="fb3709ed7b39464eb736837ee9167d04">tempest-ServerActionsTestOtherB-1961924021</nova:project>
Nov 30 08:06:10 user nova-compute[74963]:       </nova:owner>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:ports>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:port uuid="9f867ffa-aeb8-4693-bce5-c4e507fad1a2">
Nov 30 08:06:10 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 08:06:10 user nova-compute[74963]:         </nova:port>
Nov 30 08:06:10 user nova-compute[74963]:       </nova:ports>
Nov 30 08:06:10 user nova-compute[74963]:     </nova:instance>
Nov 30 08:06:10 user nova-compute[74963]:   </metadata>
Nov 30 08:06:10 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:06:10 user nova-compute[74963]:     <system>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="serial">3551893b-4a59-4e6a-a961-8ea6d671632e</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="uuid">3551893b-4a59-4e6a-a961-8ea6d671632e</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:06:10 user nova-compute[74963]:     </system>
Nov 30 08:06:10 user nova-compute[74963]:   </sysinfo>
Nov 30 08:06:10 user nova-compute[74963]:   <os>
Nov 30 08:06:10 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:06:10 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:06:10 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:06:10 user nova-compute[74963]:   </os>
Nov 30 08:06:10 user nova-compute[74963]:   <features>
Nov 30 08:06:10 user nova-compute[74963]:     <acpi/>
Nov 30 08:06:10 user nova-compute[74963]:     <apic/>
Nov 30 08:06:10 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:06:10 user nova-compute[74963]:   </features>
Nov 30 08:06:10 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:06:10 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:06:10 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:06:10 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:06:10 user nova-compute[74963]:   </clock>
Nov 30 08:06:10 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:06:10 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:06:10 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:06:10 user nova-compute[74963]:   </cpu>
Nov 30 08:06:10 user nova-compute[74963]:   <devices>
Nov 30 08:06:10 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:06:10 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:06:10 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk"/>
Nov 30 08:06:10 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:06:10 user nova-compute[74963]:     </disk>
Nov 30 08:06:10 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:06:10 user nova-compute[74963]:       <mac address="fa:16:3e:35:ea:ab"/>
Nov 30 08:06:10 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:10 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:06:10 user nova-compute[74963]:       <target dev="tap9f867ffa-ae"/>
Nov 30 08:06:10 user nova-compute[74963]:     </interface>
Nov 30 08:06:10 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:06:10 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/console.log" append="off"/>
Nov 30 08:06:10 user nova-compute[74963]:     </serial>
Nov 30 08:06:10 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:06:10 user nova-compute[74963]:     <video>
Nov 30 08:06:10 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:10 user nova-compute[74963]:     </video>
Nov 30 08:06:10 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:06:10 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:06:10 user nova-compute[74963]:     </rng>
Nov 30 08:06:10 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:06:10 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:06:10 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:06:10 user nova-compute[74963]:     </memballoon>
Nov 30 08:06:10 user nova-compute[74963]:   </devices>
Nov 30 08:06:10 user nova-compute[74963]: </domain>
Nov 30 08:06:10 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1915210269',display_name='tempest-ServerActionsTestOtherB-server-1915210269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1915210269',id=1,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36ci9r8PQsZAIlncqo2lnhzQxOBqtCX/Nhuwzpg/1rHe+dDRDEWc3NXIhEOThN+3uJ2JkTtQ14Ec2v58DN2WowXRvVjxsTkVJ/eZYNznnLTsNFO26FNZYoSoo9gHV1uA==',key_name='tempest-keypair-1061087135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3709ed7b39464eb736837ee9167d04',ramdisk_id='',reservation_id='r-ij7puok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1961924021',owner_user_name='tempest-ServerActionsTestOtherB-1961924021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='709296ad4feb46a580f22f79a87233b4',uuid=3551893b-4a59-4e6a-a961-8ea6d671632e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converting VIF {"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG os_vif [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Created schema index Interface.name {{(pid=74963) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Created schema index Port.name {{(pid=74963) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Created schema index Bridge.name {{(pid=74963) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [POLLOUT] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b887bd5e-e847-5e94-90fa-ec02966b888b', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:10 user nova-compute[74963]: INFO oslo.privsep.daemon [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpwri5zmei/privsep.sock']
Nov 30 08:06:10 user sudo[84285]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpwri5zmei/privsep.sock
Nov 30 08:06:10 user sudo[84285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updating instance_info_cache with network_info: [{"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Releasing lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Instance network_info: |[{"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41518f92-3a16-4d05-aa9f-a5994f9b00f4 req-0ef2e40a-2acf-40de-8cc1-7f5355e71f8a service nova] Acquired lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.neutron [req-41518f92-3a16-4d05-aa9f-a5994f9b00f4 req-0ef2e40a-2acf-40de-8cc1-7f5355e71f8a service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Refreshing network info cache for port da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Start _get_guest_xml network_info=[{"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:06:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1895878506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1895878506',id=2,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-hf8kr2nc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:06Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=68bcb314-8197-4fe6-b986-b2554c822545,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=da46a6e7-40cb-41cf-93c3-b55ed9fff992,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda46a6e7-40') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.objects.instance [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'pci_devices' on Instance uuid 68bcb314-8197-4fe6-b986-b2554c822545 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:06:10 user nova-compute[74963]:   <uuid>68bcb314-8197-4fe6-b986-b2554c822545</uuid>
Nov 30 08:06:10 user nova-compute[74963]:   <name>instance-00000002</name>
Nov 30 08:06:10 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:06:10 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:06:10 user nova-compute[74963]:   <metadata>
Nov 30 08:06:10 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:06:10 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1895878506</nova:name>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:06:10</nova:creationTime>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:06:10 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:06:10 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:owner>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:user uuid="4b110fcb508342509690b45e1854eb81">tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member</nova:user>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:project uuid="ce233bd757b64de4bd6f6abb3230da01">tempest-ServerBootFromVolumeStableRescueTest-1834985655</nova:project>
Nov 30 08:06:10 user nova-compute[74963]:       </nova:owner>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:06:10 user nova-compute[74963]:       <nova:ports>
Nov 30 08:06:10 user nova-compute[74963]:         <nova:port uuid="da46a6e7-40cb-41cf-93c3-b55ed9fff992">
Nov 30 08:06:10 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 08:06:10 user nova-compute[74963]:         </nova:port>
Nov 30 08:06:10 user nova-compute[74963]:       </nova:ports>
Nov 30 08:06:10 user nova-compute[74963]:     </nova:instance>
Nov 30 08:06:10 user nova-compute[74963]:   </metadata>
Nov 30 08:06:10 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:06:10 user nova-compute[74963]:     <system>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="serial">68bcb314-8197-4fe6-b986-b2554c822545</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="uuid">68bcb314-8197-4fe6-b986-b2554c822545</entry>
Nov 30 08:06:10 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:06:10 user nova-compute[74963]:     </system>
Nov 30 08:06:10 user nova-compute[74963]:   </sysinfo>
Nov 30 08:06:10 user nova-compute[74963]:   <os>
Nov 30 08:06:10 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:06:10 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:06:10 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:06:10 user nova-compute[74963]:   </os>
Nov 30 08:06:10 user nova-compute[74963]:   <features>
Nov 30 08:06:10 user nova-compute[74963]:     <acpi/>
Nov 30 08:06:10 user nova-compute[74963]:     <apic/>
Nov 30 08:06:10 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:06:10 user nova-compute[74963]:   </features>
Nov 30 08:06:10 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:06:10 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:06:10 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:06:10 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:06:10 user nova-compute[74963]:   </clock>
Nov 30 08:06:10 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:06:10 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:06:10 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:06:10 user nova-compute[74963]:   </cpu>
Nov 30 08:06:10 user nova-compute[74963]:   <devices>
Nov 30 08:06:10 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:06:10 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:06:10 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk"/>
Nov 30 08:06:10 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:06:10 user nova-compute[74963]:     </disk>
Nov 30 08:06:10 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:06:10 user nova-compute[74963]:       <mac address="fa:16:3e:a1:c3:be"/>
Nov 30 08:06:10 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:10 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:06:10 user nova-compute[74963]:       <target dev="tapda46a6e7-40"/>
Nov 30 08:06:10 user nova-compute[74963]:     </interface>
Nov 30 08:06:10 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:06:10 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/console.log" append="off"/>
Nov 30 08:06:10 user nova-compute[74963]:     </serial>
Nov 30 08:06:10 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:06:10 user nova-compute[74963]:     <video>
Nov 30 08:06:10 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:10 user nova-compute[74963]:     </video>
Nov 30 08:06:10 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:06:10 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:06:10 user nova-compute[74963]:     </rng>
Nov 30 08:06:10 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:06:10 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:06:10 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:06:10 user nova-compute[74963]:     </memballoon>
Nov 30 08:06:10 user nova-compute[74963]:   </devices>
Nov 30 08:06:10 user nova-compute[74963]: </domain>
Nov 30 08:06:10 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1895878506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1895878506',id=2,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-hf8kr2nc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:06Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=68bcb314-8197-4fe6-b986-b2554c822545,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=da46a6e7-40cb-41cf-93c3-b55ed9fff992,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda46a6e7-40') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG os_vif [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=da46a6e7-40cb-41cf-93c3-b55ed9fff992,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda46a6e7-40') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0163fb63-4de8-5298-ab45-e4d4fd312307', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Successfully updated port: 98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "refresh_cache-12839e0a-b601-49f3-910e-fb41627ba2c7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquired lock "refresh_cache-12839e0a-b601-49f3-910e-fb41627ba2c7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:06:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Successfully updated port: cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquired lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.compute.manager [req-0bf6c296-f117-4c11-84ca-281c6899327a req-61405213-0571-4f93-a03b-a844577d63ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received event network-changed-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.compute.manager [req-0bf6c296-f117-4c11-84ca-281c6899327a req-61405213-0571-4f93-a03b-a844577d63ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Refreshing instance network info cache due to event network-changed-cd8b2c94-905e-4551-8ed2-8508fb3c658f. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0bf6c296-f117-4c11-84ca-281c6899327a req-61405213-0571-4f93-a03b-a844577d63ff service nova] Acquiring lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-41cbc3a8-d5fb-4066-938e-e0ba4b5f27d8 req-c6893a18-4b28-421a-a464-5f683aab64f4 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updated VIF entry in instance network info cache for port 9f867ffa-aeb8-4693-bce5-c4e507fad1a2. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-41cbc3a8-d5fb-4066-938e-e0ba4b5f27d8 req-c6893a18-4b28-421a-a464-5f683aab64f4 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41cbc3a8-d5fb-4066-938e-e0ba4b5f27d8 req-c6893a18-4b28-421a-a464-5f683aab64f4 service nova] Releasing lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Updating instance_info_cache with network_info: [{"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-41518f92-3a16-4d05-aa9f-a5994f9b00f4 req-0ef2e40a-2acf-40de-8cc1-7f5355e71f8a service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updated VIF entry in instance network info cache for port da46a6e7-40cb-41cf-93c3-b55ed9fff992. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-41518f92-3a16-4d05-aa9f-a5994f9b00f4 req-0ef2e40a-2acf-40de-8cc1-7f5355e71f8a service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updating instance_info_cache with network_info: [{"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41518f92-3a16-4d05-aa9f-a5994f9b00f4 req-0ef2e40a-2acf-40de-8cc1-7f5355e71f8a service nova] Releasing lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Releasing lock "refresh_cache-12839e0a-b601-49f3-910e-fb41627ba2c7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Instance network_info: |[{"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Start _get_guest_xml network_info=[{"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:06:11 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:11 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:06:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1508935788',display_name='tempest-DeleteServersTestJSON-server-1508935788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1508935788',id=3,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134571570f864b598a5b419156d7847e',ramdisk_id='',reservation_id='r-pccr6kp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1272836046',owner_user_name='tempest-DeleteServersTestJSON-1272836046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:07Z,user_data=None,user_id='275934c9efc348e3a8a116ee8298e88d',uuid=12839e0a-b601-49f3-910e-fb41627ba2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Converting VIF {"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=98ba294c-6057-46c9-8899-c6b901972342,network=Network(3038bc7c-42b3-4406-a695-4706b8f37288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ba294c-60') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.objects.instance [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lazy-loading 'pci_devices' on Instance uuid 12839e0a-b601-49f3-910e-fb41627ba2c7 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-f0c10d1d-3238-4f9f-bab5-09524f2773e9 req-ba5b2bb3-4f92-4e5c-8338-da83e24b1b95 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received event network-changed-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-f0c10d1d-3238-4f9f-bab5-09524f2773e9 req-ba5b2bb3-4f92-4e5c-8338-da83e24b1b95 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Refreshing instance network info cache due to event network-changed-98ba294c-6057-46c9-8899-c6b901972342. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f0c10d1d-3238-4f9f-bab5-09524f2773e9 req-ba5b2bb3-4f92-4e5c-8338-da83e24b1b95 service nova] Acquiring lock "refresh_cache-12839e0a-b601-49f3-910e-fb41627ba2c7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f0c10d1d-3238-4f9f-bab5-09524f2773e9 req-ba5b2bb3-4f92-4e5c-8338-da83e24b1b95 service nova] Acquired lock "refresh_cache-12839e0a-b601-49f3-910e-fb41627ba2c7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-f0c10d1d-3238-4f9f-bab5-09524f2773e9 req-ba5b2bb3-4f92-4e5c-8338-da83e24b1b95 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Refreshing network info cache for port 98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:06:12 user nova-compute[74963]:   <uuid>12839e0a-b601-49f3-910e-fb41627ba2c7</uuid>
Nov 30 08:06:12 user nova-compute[74963]:   <name>instance-00000003</name>
Nov 30 08:06:12 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:06:12 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:06:12 user nova-compute[74963]:   <metadata>
Nov 30 08:06:12 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:06:12 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:name>tempest-DeleteServersTestJSON-server-1508935788</nova:name>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:06:11</nova:creationTime>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:06:12 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:06:12 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:owner>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:user uuid="275934c9efc348e3a8a116ee8298e88d">tempest-DeleteServersTestJSON-1272836046-project-member</nova:user>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:project uuid="134571570f864b598a5b419156d7847e">tempest-DeleteServersTestJSON-1272836046</nova:project>
Nov 30 08:06:12 user nova-compute[74963]:       </nova:owner>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:ports>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:port uuid="98ba294c-6057-46c9-8899-c6b901972342">
Nov 30 08:06:12 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 08:06:12 user nova-compute[74963]:         </nova:port>
Nov 30 08:06:12 user nova-compute[74963]:       </nova:ports>
Nov 30 08:06:12 user nova-compute[74963]:     </nova:instance>
Nov 30 08:06:12 user nova-compute[74963]:   </metadata>
Nov 30 08:06:12 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:06:12 user nova-compute[74963]:     <system>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="serial">12839e0a-b601-49f3-910e-fb41627ba2c7</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="uuid">12839e0a-b601-49f3-910e-fb41627ba2c7</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:06:12 user nova-compute[74963]:     </system>
Nov 30 08:06:12 user nova-compute[74963]:   </sysinfo>
Nov 30 08:06:12 user nova-compute[74963]:   <os>
Nov 30 08:06:12 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:06:12 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:06:12 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:06:12 user nova-compute[74963]:   </os>
Nov 30 08:06:12 user nova-compute[74963]:   <features>
Nov 30 08:06:12 user nova-compute[74963]:     <acpi/>
Nov 30 08:06:12 user nova-compute[74963]:     <apic/>
Nov 30 08:06:12 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:06:12 user nova-compute[74963]:   </features>
Nov 30 08:06:12 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:06:12 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:06:12 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:06:12 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:06:12 user nova-compute[74963]:   </clock>
Nov 30 08:06:12 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:06:12 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:06:12 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:06:12 user nova-compute[74963]:   </cpu>
Nov 30 08:06:12 user nova-compute[74963]:   <devices>
Nov 30 08:06:12 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:06:12 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:06:12 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk"/>
Nov 30 08:06:12 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:06:12 user nova-compute[74963]:     </disk>
Nov 30 08:06:12 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:06:12 user nova-compute[74963]:       <mac address="fa:16:3e:78:a4:a1"/>
Nov 30 08:06:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:12 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:06:12 user nova-compute[74963]:       <target dev="tap98ba294c-60"/>
Nov 30 08:06:12 user nova-compute[74963]:     </interface>
Nov 30 08:06:12 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:06:12 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/console.log" append="off"/>
Nov 30 08:06:12 user nova-compute[74963]:     </serial>
Nov 30 08:06:12 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:06:12 user nova-compute[74963]:     <video>
Nov 30 08:06:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:12 user nova-compute[74963]:     </video>
Nov 30 08:06:12 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:06:12 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:06:12 user nova-compute[74963]:     </rng>
Nov 30 08:06:12 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:06:12 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:06:12 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:06:12 user nova-compute[74963]:     </memballoon>
Nov 30 08:06:12 user nova-compute[74963]:   </devices>
Nov 30 08:06:12 user nova-compute[74963]: </domain>
Nov 30 08:06:12 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1508935788',display_name='tempest-DeleteServersTestJSON-server-1508935788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1508935788',id=3,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134571570f864b598a5b419156d7847e',ramdisk_id='',reservation_id='r-pccr6kp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1272836046',owner_user_name='tempest-DeleteServersTestJSON-1272836046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:07Z,user_data=None,user_id='275934c9efc348e3a8a116ee8298e88d',uuid=12839e0a-b601-49f3-910e-fb41627ba2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Converting VIF {"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=98ba294c-6057-46c9-8899-c6b901972342,network=Network(3038bc7c-42b3-4406-a695-4706b8f37288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ba294c-60') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG os_vif [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=98ba294c-6057-46c9-8899-c6b901972342,network=Network(3038bc7c-42b3-4406-a695-4706b8f37288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ba294c-60') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c09c574-b979-5793-8ee6-f3eb0476adb6', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:12 user sudo[84285]: pam_unix(sudo:session): session closed for user root
Nov 30 08:06:12 user nova-compute[74963]: INFO oslo.privsep.daemon [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Spawned new privsep daemon via rootwrap
Nov 30 08:06:12 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 08:06:12 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 08:06:12 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 30 08:06:12 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84288
Nov 30 08:06:12 user nova-compute[74963]: WARNING oslo_privsep.priv_context [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] privsep daemon already running
Nov 30 08:06:12 user nova-compute[74963]: WARNING oslo_privsep.priv_context [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] privsep daemon already running
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Updating instance_info_cache with network_info: [{"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Releasing lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Instance network_info: |[{"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0bf6c296-f117-4c11-84ca-281c6899327a req-61405213-0571-4f93-a03b-a844577d63ff service nova] Acquired lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-0bf6c296-f117-4c11-84ca-281c6899327a req-61405213-0571-4f93-a03b-a844577d63ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Refreshing network info cache for port cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Start _get_guest_xml network_info=[{"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:06:12 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:12 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2133869070',display_name='tempest-ServersNegativeTestJSON-server-2133869070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2133869070',id=4,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e5b724c4d64e9f9900b7bad1c2a00f',ramdisk_id='',reservation_id='r-4myjh2kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1755407575',owner_user_name='tempest-ServersNegativeTestJSON-1755407575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:07Z,user_data=None,user_id='63de4ab983be439488dc30077810b5f0',uuid=25afcf51-de30-4a53-bb6b-3e7037f5e386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converting VIF {"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ea:4c,bridge_name='br-int',has_traffic_filtering=True,id=cd8b2c94-905e-4551-8ed2-8508fb3c658f,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8b2c94-90') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lazy-loading 'pci_devices' on Instance uuid 25afcf51-de30-4a53-bb6b-3e7037f5e386 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-f0c10d1d-3238-4f9f-bab5-09524f2773e9 req-ba5b2bb3-4f92-4e5c-8338-da83e24b1b95 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Updated VIF entry in instance network info cache for port 98ba294c-6057-46c9-8899-c6b901972342. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-f0c10d1d-3238-4f9f-bab5-09524f2773e9 req-ba5b2bb3-4f92-4e5c-8338-da83e24b1b95 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Updating instance_info_cache with network_info: [{"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f867ffa-ae, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f867ffa-ae, col_values=(('qos', UUID('10bfc461-52c3-45bb-962d-4c7dcac22ead')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f867ffa-ae, col_values=(('external_ids', {'iface-id': '9f867ffa-aeb8-4693-bce5-c4e507fad1a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:ea:ab', 'vm-uuid': '3551893b-4a59-4e6a-a961-8ea6d671632e'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:06:12 user nova-compute[74963]:   <uuid>25afcf51-de30-4a53-bb6b-3e7037f5e386</uuid>
Nov 30 08:06:12 user nova-compute[74963]:   <name>instance-00000004</name>
Nov 30 08:06:12 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:06:12 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:06:12 user nova-compute[74963]:   <metadata>
Nov 30 08:06:12 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:06:12 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:name>tempest-ServersNegativeTestJSON-server-2133869070</nova:name>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:06:12</nova:creationTime>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:06:12 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:06:12 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:owner>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:user uuid="63de4ab983be439488dc30077810b5f0">tempest-ServersNegativeTestJSON-1755407575-project-member</nova:user>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:project uuid="12e5b724c4d64e9f9900b7bad1c2a00f">tempest-ServersNegativeTestJSON-1755407575</nova:project>
Nov 30 08:06:12 user nova-compute[74963]:       </nova:owner>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:06:12 user nova-compute[74963]:       <nova:ports>
Nov 30 08:06:12 user nova-compute[74963]:         <nova:port uuid="cd8b2c94-905e-4551-8ed2-8508fb3c658f">
Nov 30 08:06:12 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 08:06:12 user nova-compute[74963]:         </nova:port>
Nov 30 08:06:12 user nova-compute[74963]:       </nova:ports>
Nov 30 08:06:12 user nova-compute[74963]:     </nova:instance>
Nov 30 08:06:12 user nova-compute[74963]:   </metadata>
Nov 30 08:06:12 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:06:12 user nova-compute[74963]:     <system>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="serial">25afcf51-de30-4a53-bb6b-3e7037f5e386</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="uuid">25afcf51-de30-4a53-bb6b-3e7037f5e386</entry>
Nov 30 08:06:12 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:06:12 user nova-compute[74963]:     </system>
Nov 30 08:06:12 user nova-compute[74963]:   </sysinfo>
Nov 30 08:06:12 user nova-compute[74963]:   <os>
Nov 30 08:06:12 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:06:12 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:06:12 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:06:12 user nova-compute[74963]:   </os>
Nov 30 08:06:12 user nova-compute[74963]:   <features>
Nov 30 08:06:12 user nova-compute[74963]:     <acpi/>
Nov 30 08:06:12 user nova-compute[74963]:     <apic/>
Nov 30 08:06:12 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:06:12 user nova-compute[74963]:   </features>
Nov 30 08:06:12 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:06:12 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:06:12 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:06:12 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:06:12 user nova-compute[74963]:   </clock>
Nov 30 08:06:12 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:06:12 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:06:12 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:06:12 user nova-compute[74963]:   </cpu>
Nov 30 08:06:12 user nova-compute[74963]:   <devices>
Nov 30 08:06:12 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:06:12 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:06:12 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk"/>
Nov 30 08:06:12 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:06:12 user nova-compute[74963]:     </disk>
Nov 30 08:06:12 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:06:12 user nova-compute[74963]:       <mac address="fa:16:3e:f4:ea:4c"/>
Nov 30 08:06:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:12 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:06:12 user nova-compute[74963]:       <target dev="tapcd8b2c94-90"/>
Nov 30 08:06:12 user nova-compute[74963]:     </interface>
Nov 30 08:06:12 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:06:12 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/console.log" append="off"/>
Nov 30 08:06:12 user nova-compute[74963]:     </serial>
Nov 30 08:06:12 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:06:12 user nova-compute[74963]:     <video>
Nov 30 08:06:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:12 user nova-compute[74963]:     </video>
Nov 30 08:06:12 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:06:12 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:06:12 user nova-compute[74963]:     </rng>
Nov 30 08:06:12 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:06:12 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:06:12 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:06:12 user nova-compute[74963]:     </memballoon>
Nov 30 08:06:12 user nova-compute[74963]:   </devices>
Nov 30 08:06:12 user nova-compute[74963]: </domain>
Nov 30 08:06:12 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2133869070',display_name='tempest-ServersNegativeTestJSON-server-2133869070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2133869070',id=4,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e5b724c4d64e9f9900b7bad1c2a00f',ramdisk_id='',reservation_id='r-4myjh2kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1755407575',owner_user_name='tempest-ServersNegativeTestJSON-1755407575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:07Z,user_data=None,user_id='63de4ab983be439488dc30077810b5f0',uuid=25afcf51-de30-4a53-bb6b-3e7037f5e386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converting VIF {"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ea:4c,bridge_name='br-int',has_traffic_filtering=True,id=cd8b2c94-905e-4551-8ed2-8508fb3c658f,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8b2c94-90') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG os_vif [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ea:4c,bridge_name='br-int',has_traffic_filtering=True,id=cd8b2c94-905e-4551-8ed2-8508fb3c658f,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8b2c94-90') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f0c10d1d-3238-4f9f-bab5-09524f2773e9 req-ba5b2bb3-4f92-4e5c-8338-da83e24b1b95 service nova] Releasing lock "refresh_cache-12839e0a-b601-49f3-910e-fb41627ba2c7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: INFO os_vif [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae')
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda46a6e7-40, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda46a6e7-40, col_values=(('qos', UUID('f8cbd4a4-2db1-462b-89f0-cedd783543d1')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda46a6e7-40, col_values=(('external_ids', {'iface-id': 'da46a6e7-40cb-41cf-93c3-b55ed9fff992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:c3:be', 'vm-uuid': '68bcb314-8197-4fe6-b986-b2554c822545'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: INFO os_vif [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=da46a6e7-40cb-41cf-93c3-b55ed9fff992,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda46a6e7-40')
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2692e3e-f71a-5078-83d2-6c1681f91a68', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98ba294c-60, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98ba294c-60, col_values=(('qos', UUID('e65cfad9-76cf-472e-952a-f0226112c93f')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98ba294c-60, col_values=(('external_ids', {'iface-id': '98ba294c-6057-46c9-8899-c6b901972342', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:a4:a1', 'vm-uuid': '12839e0a-b601-49f3-910e-fb41627ba2c7'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] No VIF found with MAC fa:16:3e:35:ea:ab, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No VIF found with MAC fa:16:3e:a1:c3:be, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: INFO os_vif [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=98ba294c-6057-46c9-8899-c6b901972342,network=Network(3038bc7c-42b3-4406-a695-4706b8f37288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ba294c-60')
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd8b2c94-90, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd8b2c94-90, col_values=(('qos', UUID('3d9df21b-db4a-410f-bb85-f21a3dcf1dba')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd8b2c94-90, col_values=(('external_ids', {'iface-id': 'cd8b2c94-905e-4551-8ed2-8508fb3c658f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ea:4c', 'vm-uuid': '25afcf51-de30-4a53-bb6b-3e7037f5e386'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:12 user nova-compute[74963]: INFO os_vif [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ea:4c,bridge_name='br-int',has_traffic_filtering=True,id=cd8b2c94-905e-4551-8ed2-8508fb3c658f,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8b2c94-90')
Nov 30 08:06:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] No VIF found with MAC fa:16:3e:78:a4:a1, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:06:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] No VIF found with MAC fa:16:3e:f4:ea:4c, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:06:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-0bf6c296-f117-4c11-84ca-281c6899327a req-61405213-0571-4f93-a03b-a844577d63ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Updated VIF entry in instance network info cache for port cd8b2c94-905e-4551-8ed2-8508fb3c658f. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:06:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-0bf6c296-f117-4c11-84ca-281c6899327a req-61405213-0571-4f93-a03b-a844577d63ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Updating instance_info_cache with network_info: [{"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0bf6c296-f117-4c11-84ca-281c6899327a req-61405213-0571-4f93-a03b-a844577d63ff service nova] Releasing lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:06:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:06:20 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance spawned successfully.
Nov 30 08:06:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: INFO nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Took 17.95 seconds to spawn the instance on the hypervisor.
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:06:21 user nova-compute[74963]: INFO nova.compute.manager [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Took 19.07 seconds to build instance.
Nov 30 08:06:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f4abdf09-e689-44e8-a388-160a16ea33b8 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.512s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:06:21 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Instance spawned successfully.
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: INFO nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Took 14.59 seconds to spawn the instance on the hypervisor.
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:06:22 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Instance spawned successfully.
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: INFO nova.compute.manager [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Took 16.05 seconds to build instance.
Nov 30 08:06:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cfdc6852-7503-44de-9136-e6300f74c0d2 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.322s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:06:22 user nova-compute[74963]: INFO nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Took 15.98 seconds to spawn the instance on the hypervisor.
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:06:22 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Instance spawned successfully.
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:22 user nova-compute[74963]: INFO nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Took 15.64 seconds to spawn the instance on the hypervisor.
Nov 30 08:06:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:06:22 user nova-compute[74963]: INFO nova.compute.manager [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Took 17.06 seconds to build instance.
Nov 30 08:06:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65d84c49-db91-4f28-acca-67d9834fdff8 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "68bcb314-8197-4fe6-b986-b2554c822545" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.221s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:22 user nova-compute[74963]: INFO nova.compute.manager [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Took 16.75 seconds to build instance.
Nov 30 08:06:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7ba4026-57b9-4970-a854-c7eb954b1aa8 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.887s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:22 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-57a3269a-8949-4bac-a760-7e1889b6c770 req-29208af3-3546-45ff-9372-d0b3363e991c service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received event network-vif-plugged-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-57a3269a-8949-4bac-a760-7e1889b6c770 req-29208af3-3546-45ff-9372-d0b3363e991c service nova] Acquiring lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-57a3269a-8949-4bac-a760-7e1889b6c770 req-29208af3-3546-45ff-9372-d0b3363e991c service nova] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-57a3269a-8949-4bac-a760-7e1889b6c770 req-29208af3-3546-45ff-9372-d0b3363e991c service nova] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-57a3269a-8949-4bac-a760-7e1889b6c770 req-29208af3-3546-45ff-9372-d0b3363e991c service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] No waiting events found dispatching network-vif-plugged-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:24 user nova-compute[74963]: WARNING nova.compute.manager [req-57a3269a-8949-4bac-a760-7e1889b6c770 req-29208af3-3546-45ff-9372-d0b3363e991c service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received unexpected event network-vif-plugged-98ba294c-6057-46c9-8899-c6b901972342 for instance with vm_state active and task_state None.
Nov 30 08:06:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:06:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:25 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:06:25 user nova-compute[74963]: INFO nova.compute.claims [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Claim successful on node user
Nov 30 08:06:26 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-23cb5d57-d8fe-4dbc-a7a7-d0f975de81c7 req-03672b84-d115-47d6-a4de-d4a85c855c19 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received event network-vif-plugged-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-23cb5d57-d8fe-4dbc-a7a7-d0f975de81c7 req-03672b84-d115-47d6-a4de-d4a85c855c19 service nova] Acquiring lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-23cb5d57-d8fe-4dbc-a7a7-d0f975de81c7 req-03672b84-d115-47d6-a4de-d4a85c855c19 service nova] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-23cb5d57-d8fe-4dbc-a7a7-d0f975de81c7 req-03672b84-d115-47d6-a4de-d4a85c855c19 service nova] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-23cb5d57-d8fe-4dbc-a7a7-d0f975de81c7 req-03672b84-d115-47d6-a4de-d4a85c855c19 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] No waiting events found dispatching network-vif-plugged-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:26 user nova-compute[74963]: WARNING nova.compute.manager [req-23cb5d57-d8fe-4dbc-a7a7-d0f975de81c7 req-03672b84-d115-47d6-a4de-d4a85c855c19 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received unexpected event network-vif-plugged-98ba294c-6057-46c9-8899-c6b901972342 for instance with vm_state active and task_state None.
Nov 30 08:06:26 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.765s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 30 08:06:26 user nova-compute[74963]: DEBUG nova.policy [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6f08e40602c4a579125cb22746a521e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b8cc5f69f422eb10f77b4c081f87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:06:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:06:27 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:06:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:06:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Creating image(s)
Nov 30 08:06:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "/opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "/opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "dedb8db18a6c9ce45d12d1a066451becedebebf9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "dedb8db18a6c9ce45d12d1a066451becedebebf9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9.part --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9.part --force-share --output=json" returned: 0 in 0.272s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG nova.virt.images [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] 47cac5d5-780e-4b6c-9f79-7dffe3232b6f was qcow2, converting to raw {{(pid=74963) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9.part /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9.converted {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9.part /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9.converted" returned: 0 in 0.324s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9.converted --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9.converted --force-share --output=json" returned: 0 in 0.307s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "dedb8db18a6c9ce45d12d1a066451becedebebf9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.776s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Successfully created port: a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9 --force-share --output=json" returned: 0 in 0.290s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "dedb8db18a6c9ce45d12d1a066451becedebebf9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "dedb8db18a6c9ce45d12d1a066451becedebebf9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:06:29 user nova-compute[74963]: INFO nova.compute.claims [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Claim successful on node user
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9 --force-share --output=json" returned: 0 in 0.403s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9,backing_fmt=raw /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9,backing_fmt=raw /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk 1073741824" returned: 0 in 0.090s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "dedb8db18a6c9ce45d12d1a066451becedebebf9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.504s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Successfully updated port: a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "refresh_cache-ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquired lock "refresh_cache-ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dedb8db18a6c9ce45d12d1a066451becedebebf9 --force-share --output=json" returned: 0 in 0.428s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.compute.manager [req-16d601c6-7a12-47f2-bef2-fdce5f9b32e6 req-48213d2d-f793-4021-85cf-c4e2c8e5e894 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received event network-changed-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.compute.manager [req-16d601c6-7a12-47f2-bef2-fdce5f9b32e6 req-48213d2d-f793-4021-85cf-c4e2c8e5e894 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Refreshing instance network info cache due to event network-changed-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-16d601c6-7a12-47f2-bef2-fdce5f9b32e6 req-48213d2d-f793-4021-85cf-c4e2c8e5e894 service nova] Acquiring lock "refresh_cache-ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:06:30 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Cannot resize image /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Ensure instance console log exists: /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.policy [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c56ffed9753a4606b25aeba883c7a7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5e0955acb4580a76ec98a9233eb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "9579e650-53bf-4772-888e-aa95a4108f75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:06:30 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Creating image(s)
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "/opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "/opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "/opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:06:30 user nova-compute[74963]: INFO nova.compute.claims [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Claim successful on node user
Nov 30 08:06:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Updating instance_info_cache with network_info: [{"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Releasing lock "refresh_cache-ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Instance network_info: |[{"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-16d601c6-7a12-47f2-bef2-fdce5f9b32e6 req-48213d2d-f793-4021-85cf-c4e2c8e5e894 service nova] Acquired lock "refresh_cache-ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.network.neutron [req-16d601c6-7a12-47f2-bef2-fdce5f9b32e6 req-48213d2d-f793-4021-85cf-c4e2c8e5e894 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Refreshing network info cache for port a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Start _get_guest_xml network_info=[{"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:06:17Z,direct_url=<?>,disk_format='qcow2',id=47cac5d5-780e-4b6c-9f79-7dffe3232b6f,min_disk=0,min_ram=0,name='',owner='6d829ece5f8f4cebb54ab9b962fc4c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:06:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'scsi', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': '47cac5d5-780e-4b6c-9f79-7dffe3232b6f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.363s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:31 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:31 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:06:17Z,direct_url=<?>,disk_format='qcow2',id=47cac5d5-780e-4b6c-9f79-7dffe3232b6f,min_disk=0,min_ram=0,name='',owner='6d829ece5f8f4cebb54ab9b962fc4c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:06:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1538004864',display_name='tempest-AttachSCSIVolumeTestJSON-server-1538004864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1538004864',id=5,image_ref='47cac5d5-780e-4b6c-9f79-7dffe3232b6f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhkg3y1tgIdZ3tkH+NQc2PrVfvtcEHgZgZLPIBi7glR9bP1ag2n7qASeezdmVHzYYC/2n71E/kOYBHj//K6irqh+85stqXhvqWIEt686En9TtxIJbBFzLN0AsE7404z7Q==',key_name='tempest-keypair-27342145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b2b8cc5f69f422eb10f77b4c081f87a',ramdisk_id='',reservation_id='r-z1vjqixb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='47cac5d5-780e-4b6c-9f79-7dffe3232b6f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-708425414',owner_user_name='tempest-AttachSCSIVolumeTestJSON-708425414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6f08e40602c4a579125cb22746a521e',uuid=ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Converting VIF {"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:18,bridge_name='br-int',has_traffic_filtering=True,id=a52e00e9-66d0-4b80-b8f5-09aa9081e6c3,network=Network(250dbef3-83c3-49cb-94f8-d7d625b14cca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52e00e9-66') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lazy-loading 'pci_devices' on Instance uuid ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:06:31 user nova-compute[74963]:   <uuid>ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8</uuid>
Nov 30 08:06:31 user nova-compute[74963]:   <name>instance-00000005</name>
Nov 30 08:06:31 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:06:31 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:06:31 user nova-compute[74963]:   <metadata>
Nov 30 08:06:31 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:06:31 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:06:31 user nova-compute[74963]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1538004864</nova:name>
Nov 30 08:06:31 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:06:31</nova:creationTime>
Nov 30 08:06:31 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:06:31 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:06:31 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:06:31 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:06:31 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:06:31 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:06:31 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:06:31 user nova-compute[74963]:       <nova:owner>
Nov 30 08:06:31 user nova-compute[74963]:         <nova:user uuid="c6f08e40602c4a579125cb22746a521e">tempest-AttachSCSIVolumeTestJSON-708425414-project-member</nova:user>
Nov 30 08:06:31 user nova-compute[74963]:         <nova:project uuid="5b2b8cc5f69f422eb10f77b4c081f87a">tempest-AttachSCSIVolumeTestJSON-708425414</nova:project>
Nov 30 08:06:31 user nova-compute[74963]:       </nova:owner>
Nov 30 08:06:31 user nova-compute[74963]:       <nova:root type="image" uuid="47cac5d5-780e-4b6c-9f79-7dffe3232b6f"/>
Nov 30 08:06:31 user nova-compute[74963]:       <nova:ports>
Nov 30 08:06:31 user nova-compute[74963]:         <nova:port uuid="a52e00e9-66d0-4b80-b8f5-09aa9081e6c3">
Nov 30 08:06:31 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 08:06:31 user nova-compute[74963]:         </nova:port>
Nov 30 08:06:31 user nova-compute[74963]:       </nova:ports>
Nov 30 08:06:31 user nova-compute[74963]:     </nova:instance>
Nov 30 08:06:31 user nova-compute[74963]:   </metadata>
Nov 30 08:06:31 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:06:31 user nova-compute[74963]:     <system>
Nov 30 08:06:31 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:06:31 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:06:31 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:06:31 user nova-compute[74963]:       <entry name="serial">ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8</entry>
Nov 30 08:06:31 user nova-compute[74963]:       <entry name="uuid">ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8</entry>
Nov 30 08:06:31 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:06:31 user nova-compute[74963]:     </system>
Nov 30 08:06:31 user nova-compute[74963]:   </sysinfo>
Nov 30 08:06:31 user nova-compute[74963]:   <os>
Nov 30 08:06:31 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:06:31 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:06:31 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:06:31 user nova-compute[74963]:   </os>
Nov 30 08:06:31 user nova-compute[74963]:   <features>
Nov 30 08:06:31 user nova-compute[74963]:     <acpi/>
Nov 30 08:06:31 user nova-compute[74963]:     <apic/>
Nov 30 08:06:31 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:06:31 user nova-compute[74963]:   </features>
Nov 30 08:06:31 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:06:31 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:06:31 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:06:31 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:06:31 user nova-compute[74963]:   </clock>
Nov 30 08:06:31 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:06:31 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:06:31 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:06:31 user nova-compute[74963]:   </cpu>
Nov 30 08:06:31 user nova-compute[74963]:   <devices>
Nov 30 08:06:31 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:06:31 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:06:31 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk"/>
Nov 30 08:06:31 user nova-compute[74963]:       <target dev="sda" bus="scsi"/>
Nov 30 08:06:31 user nova-compute[74963]:       <address type="drive" controller="0" unit="0"/>
Nov 30 08:06:31 user nova-compute[74963]:     </disk>
Nov 30 08:06:31 user nova-compute[74963]:     <disk type="file" device="cdrom">
Nov 30 08:06:31 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 08:06:31 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk.config"/>
Nov 30 08:06:31 user nova-compute[74963]:       <target dev="sdb" bus="scsi"/>
Nov 30 08:06:31 user nova-compute[74963]:       <address type="drive" controller="0" unit="1"/>
Nov 30 08:06:31 user nova-compute[74963]:     </disk>
Nov 30 08:06:31 user nova-compute[74963]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 30 08:06:31 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:06:31 user nova-compute[74963]:       <mac address="fa:16:3e:a3:31:18"/>
Nov 30 08:06:31 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:31 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:06:31 user nova-compute[74963]:       <target dev="tapa52e00e9-66"/>
Nov 30 08:06:31 user nova-compute[74963]:     </interface>
Nov 30 08:06:31 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:06:31 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/console.log" append="off"/>
Nov 30 08:06:31 user nova-compute[74963]:     </serial>
Nov 30 08:06:31 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:06:31 user nova-compute[74963]:     <video>
Nov 30 08:06:31 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:31 user nova-compute[74963]:     </video>
Nov 30 08:06:31 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:06:31 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:06:31 user nova-compute[74963]:     </rng>
Nov 30 08:06:31 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:06:31 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:06:31 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:06:31 user nova-compute[74963]:     </memballoon>
Nov 30 08:06:31 user nova-compute[74963]:   </devices>
Nov 30 08:06:31 user nova-compute[74963]: </domain>
Nov 30 08:06:31 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1538004864',display_name='tempest-AttachSCSIVolumeTestJSON-server-1538004864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1538004864',id=5,image_ref='47cac5d5-780e-4b6c-9f79-7dffe3232b6f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhkg3y1tgIdZ3tkH+NQc2PrVfvtcEHgZgZLPIBi7glR9bP1ag2n7qASeezdmVHzYYC/2n71E/kOYBHj//K6irqh+85stqXhvqWIEt686En9TtxIJbBFzLN0AsE7404z7Q==',key_name='tempest-keypair-27342145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b2b8cc5f69f422eb10f77b4c081f87a',ramdisk_id='',reservation_id='r-z1vjqixb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='47cac5d5-780e-4b6c-9f79-7dffe3232b6f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-708425414',owner_user_name='tempest-AttachSCSIVolumeTestJSON-708425414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6f08e40602c4a579125cb22746a521e',uuid=ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Converting VIF {"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:18,bridge_name='br-int',has_traffic_filtering=True,id=a52e00e9-66d0-4b80-b8f5-09aa9081e6c3,network=Network(250dbef3-83c3-49cb-94f8-d7d625b14cca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52e00e9-66') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG os_vif [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:18,bridge_name='br-int',has_traffic_filtering=True,id=a52e00e9-66d0-4b80-b8f5-09aa9081e6c3,network=Network(250dbef3-83c3-49cb-94f8-d7d625b14cca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52e00e9-66') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9452b8d4-e2c0-534d-89b1-5ad9e3af03c6', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa52e00e9-66, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa52e00e9-66, col_values=(('qos', UUID('8f36f2e5-8e6e-49bc-93f1-bbe634dd06ed')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa52e00e9-66, col_values=(('external_ids', {'iface-id': 'a52e00e9-66d0-4b80-b8f5-09aa9081e6c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:31:18', 'vm-uuid': 'ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:31 user nova-compute[74963]: INFO os_vif [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:18,bridge_name='br-int',has_traffic_filtering=True,id=a52e00e9-66d0-4b80-b8f5-09aa9081e6c3,network=Network(250dbef3-83c3-49cb-94f8-d7d625b14cca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52e00e9-66')
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.334s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk 1073741824" returned: 0 in 0.112s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.452s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] No BDM found with device name sda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] No VIF found with MAC fa:16:3e:a3:31:18, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:06:31 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Using config drive
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.053s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.414s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:06:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:06:32 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Cannot resize image /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Ensure instance console log exists: /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.policy [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b12c28a89dc4c5a8148e87d813c9c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add45f088a414c8d8a602f23e061700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:06:32 user nova-compute[74963]: INFO nova.compute.claims [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Claim successful on node user
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:06:32 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Creating image(s)
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquiring lock "/opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "/opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "/opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Successfully created port: c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.network.neutron [req-16d601c6-7a12-47f2-bef2-fdce5f9b32e6 req-48213d2d-f793-4021-85cf-c4e2c8e5e894 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Updated VIF entry in instance network info cache for port a52e00e9-66d0-4b80-b8f5-09aa9081e6c3. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG nova.network.neutron [req-16d601c6-7a12-47f2-bef2-fdce5f9b32e6 req-48213d2d-f793-4021-85cf-c4e2c8e5e894 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Updating instance_info_cache with network_info: [{"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-16d601c6-7a12-47f2-bef2-fdce5f9b32e6 req-48213d2d-f793-4021-85cf-c4e2c8e5e894 service nova] Releasing lock "refresh_cache-ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.316s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:32 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Creating config drive at /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk.config
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn2jexp_7 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn2jexp_7" returned: 0 in 0.097s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.236s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk 1073741824" returned: 0 in 0.149s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.390s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.110s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.355s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Successfully updated port: c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Successfully created port: c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquired lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-e7fde5f6-1247-4127-bfec-89bc0a5912a1 req-97e21411-502f-46d4-ad16-3b3c639b2d55 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received event network-changed-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-e7fde5f6-1247-4127-bfec-89bc0a5912a1 req-97e21411-502f-46d4-ad16-3b3c639b2d55 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Refreshing instance network info cache due to event network-changed-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7fde5f6-1247-4127-bfec-89bc0a5912a1 req-97e21411-502f-46d4-ad16-3b3c639b2d55 service nova] Acquiring lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.policy [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '644095bd2e894f0db86ed3a7d1a06c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069409ef36774791b13e4a3eec8d6648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:06:33 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json" returned: 0 in 0.366s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Cannot resize image /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Ensure instance console log exists: /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:06:34 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Creating image(s)
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Updating instance_info_cache with network_info: [{"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.290s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Releasing lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Instance network_info: |[{"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7fde5f6-1247-4127-bfec-89bc0a5912a1 req-97e21411-502f-46d4-ad16-3b3c639b2d55 service nova] Acquired lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.network.neutron [req-e7fde5f6-1247-4127-bfec-89bc0a5912a1 req-97e21411-502f-46d4-ad16-3b3c639b2d55 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Refreshing network info cache for port c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Start _get_guest_xml network_info=[{"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Successfully updated port: c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquiring lock "refresh_cache-9579e650-53bf-4772-888e-aa95a4108f75" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquired lock "refresh_cache-9579e650-53bf-4772-888e-aa95a4108f75" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.compute.manager [req-23facb9d-0784-4e24-9c86-de63843b201f req-bdc44bcc-853a-418c-bd74-5a9ea42f8ec3 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received event network-changed-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.compute.manager [req-23facb9d-0784-4e24-9c86-de63843b201f req-bdc44bcc-853a-418c-bd74-5a9ea42f8ec3 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Refreshing instance network info cache due to event network-changed-c797d1f2-cde0-44bf-8552-2f00b88d549a. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-23facb9d-0784-4e24-9c86-de63843b201f req-bdc44bcc-853a-418c-bd74-5a9ea42f8ec3 service nova] Acquiring lock "refresh_cache-9579e650-53bf-4772-888e-aa95a4108f75" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:34 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:34 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.282s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-670864781',display_name='tempest-TestVolumeSwap-server-670864781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-670864781',id=6,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbV5XlLnT/dacZAFYCI8rtB8uh7fUz02r2KaRAJtpzXC14nPacR+E1L9Kd9GR/LFaT6JcxA8TNp0pYahu/o964NPaoxMK6H9fuHg5D4yA5Vv2bVLj489Nl1g9dmiorSHQ==',key_name='tempest-keypair-671427234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bb5e0955acb4580a76ec98a9233eb87',ramdisk_id='',reservation_id='r-0tj0n4h2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-265069428',owner_user_name='tempest-TestVolumeSwap-265069428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56ffed9753a4606b25aeba883c7a7cb',uuid=98e1c4f0-b628-435a-bf98-f814fa927873,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Converting VIF {"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:72:4e,bridge_name='br-int',has_traffic_filtering=True,id=c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00,network=Network(9d5b9069-bd4b-4c7d-a2fa-003a11613793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5ec7a-bd') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.objects.instance [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lazy-loading 'pci_devices' on Instance uuid 98e1c4f0-b628-435a-bf98-f814fa927873 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk 1073741824" returned: 0 in 0.165s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.480s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:06:35 user nova-compute[74963]:   <uuid>98e1c4f0-b628-435a-bf98-f814fa927873</uuid>
Nov 30 08:06:35 user nova-compute[74963]:   <name>instance-00000006</name>
Nov 30 08:06:35 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:06:35 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:06:35 user nova-compute[74963]:   <metadata>
Nov 30 08:06:35 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:06:35 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:name>tempest-TestVolumeSwap-server-670864781</nova:name>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:06:34</nova:creationTime>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:06:35 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:06:35 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:owner>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:user uuid="c56ffed9753a4606b25aeba883c7a7cb">tempest-TestVolumeSwap-265069428-project-member</nova:user>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:project uuid="8bb5e0955acb4580a76ec98a9233eb87">tempest-TestVolumeSwap-265069428</nova:project>
Nov 30 08:06:35 user nova-compute[74963]:       </nova:owner>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:ports>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:port uuid="c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00">
Nov 30 08:06:35 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 08:06:35 user nova-compute[74963]:         </nova:port>
Nov 30 08:06:35 user nova-compute[74963]:       </nova:ports>
Nov 30 08:06:35 user nova-compute[74963]:     </nova:instance>
Nov 30 08:06:35 user nova-compute[74963]:   </metadata>
Nov 30 08:06:35 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:06:35 user nova-compute[74963]:     <system>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="serial">98e1c4f0-b628-435a-bf98-f814fa927873</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="uuid">98e1c4f0-b628-435a-bf98-f814fa927873</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:06:35 user nova-compute[74963]:     </system>
Nov 30 08:06:35 user nova-compute[74963]:   </sysinfo>
Nov 30 08:06:35 user nova-compute[74963]:   <os>
Nov 30 08:06:35 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:06:35 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:06:35 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:06:35 user nova-compute[74963]:   </os>
Nov 30 08:06:35 user nova-compute[74963]:   <features>
Nov 30 08:06:35 user nova-compute[74963]:     <acpi/>
Nov 30 08:06:35 user nova-compute[74963]:     <apic/>
Nov 30 08:06:35 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:06:35 user nova-compute[74963]:   </features>
Nov 30 08:06:35 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:06:35 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:06:35 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:06:35 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:06:35 user nova-compute[74963]:   </clock>
Nov 30 08:06:35 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:06:35 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:06:35 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:06:35 user nova-compute[74963]:   </cpu>
Nov 30 08:06:35 user nova-compute[74963]:   <devices>
Nov 30 08:06:35 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:06:35 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:06:35 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk"/>
Nov 30 08:06:35 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:06:35 user nova-compute[74963]:     </disk>
Nov 30 08:06:35 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:06:35 user nova-compute[74963]:       <mac address="fa:16:3e:a5:72:4e"/>
Nov 30 08:06:35 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:35 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:06:35 user nova-compute[74963]:       <target dev="tapc3a5ec7a-bd"/>
Nov 30 08:06:35 user nova-compute[74963]:     </interface>
Nov 30 08:06:35 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:06:35 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/console.log" append="off"/>
Nov 30 08:06:35 user nova-compute[74963]:     </serial>
Nov 30 08:06:35 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:06:35 user nova-compute[74963]:     <video>
Nov 30 08:06:35 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:35 user nova-compute[74963]:     </video>
Nov 30 08:06:35 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:06:35 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:06:35 user nova-compute[74963]:     </rng>
Nov 30 08:06:35 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:06:35 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:06:35 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:06:35 user nova-compute[74963]:     </memballoon>
Nov 30 08:06:35 user nova-compute[74963]:   </devices>
Nov 30 08:06:35 user nova-compute[74963]: </domain>
Nov 30 08:06:35 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-670864781',display_name='tempest-TestVolumeSwap-server-670864781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-670864781',id=6,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbV5XlLnT/dacZAFYCI8rtB8uh7fUz02r2KaRAJtpzXC14nPacR+E1L9Kd9GR/LFaT6JcxA8TNp0pYahu/o964NPaoxMK6H9fuHg5D4yA5Vv2bVLj489Nl1g9dmiorSHQ==',key_name='tempest-keypair-671427234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bb5e0955acb4580a76ec98a9233eb87',ramdisk_id='',reservation_id='r-0tj0n4h2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-265069428',owner_user_name='tempest-TestVolumeSwap-265069428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56ffed9753a4606b25aeba883c7a7cb',uuid=98e1c4f0-b628-435a-bf98-f814fa927873,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Converting VIF {"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:72:4e,bridge_name='br-int',has_traffic_filtering=True,id=c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00,network=Network(9d5b9069-bd4b-4c7d-a2fa-003a11613793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5ec7a-bd') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG os_vif [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:72:4e,bridge_name='br-int',has_traffic_filtering=True,id=c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00,network=Network(9d5b9069-bd4b-4c7d-a2fa-003a11613793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5ec7a-bd') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59c5858d-6854-5aa8-8f9a-4d9fb73efa3b', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3a5ec7a-bd, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3a5ec7a-bd, col_values=(('qos', UUID('d6eeaf8a-0149-405d-8245-0e8e1289077c')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3a5ec7a-bd, col_values=(('external_ids', {'iface-id': 'c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:72:4e', 'vm-uuid': '98e1c4f0-b628-435a-bf98-f814fa927873'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:35 user nova-compute[74963]: INFO os_vif [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:72:4e,bridge_name='br-int',has_traffic_filtering=True,id=c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00,network=Network(9d5b9069-bd4b-4c7d-a2fa-003a11613793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5ec7a-bd')
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] No VIF found with MAC fa:16:3e:a5:72:4e, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.433s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Successfully created port: 662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.neutron [req-e7fde5f6-1247-4127-bfec-89bc0a5912a1 req-97e21411-502f-46d4-ad16-3b3c639b2d55 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Updated VIF entry in instance network info cache for port c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.neutron [req-e7fde5f6-1247-4127-bfec-89bc0a5912a1 req-97e21411-502f-46d4-ad16-3b3c639b2d55 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Updating instance_info_cache with network_info: [{"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Cannot resize image /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Ensure instance console log exists: /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Updating instance_info_cache with network_info: [{"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7fde5f6-1247-4127-bfec-89bc0a5912a1 req-97e21411-502f-46d4-ad16-3b3c639b2d55 service nova] Releasing lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Releasing lock "refresh_cache-9579e650-53bf-4772-888e-aa95a4108f75" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Instance network_info: |[{"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-23facb9d-0784-4e24-9c86-de63843b201f req-bdc44bcc-853a-418c-bd74-5a9ea42f8ec3 service nova] Acquired lock "refresh_cache-9579e650-53bf-4772-888e-aa95a4108f75" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.neutron [req-23facb9d-0784-4e24-9c86-de63843b201f req-bdc44bcc-853a-418c-bd74-5a9ea42f8ec3 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Refreshing network info cache for port c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Start _get_guest_xml network_info=[{"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:06:35 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:35 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-723473140',display_name='tempest-VolumesAssistedSnapshotsTest-server-723473140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-723473140',id=7,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFsTyvXtu/UsB8DrK+A7rP5SJ26h/4akhPolxPB5bLWHWZuB2zoFRLdojCee82Bw31AR2vhWBxJY3/ABKqcYRYHCl5LFXVoVLwLr6XM/HtH3+7OczNDfnMozjfNZqiZqw==',key_name='tempest-keypair-977526846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='add45f088a414c8d8a602f23e061700d',ramdisk_id='',reservation_id='r-4ndicz4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-558289142',owner_user_name='tempest-VolumesAssistedSnapshotsTest-558289142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b12c28a89dc4c5a8148e87d813c9c2d',uuid=9579e650-53bf-4772-888e-aa95a4108f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Converting VIF {"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:c5:5e,bridge_name='br-int',has_traffic_filtering=True,id=c797d1f2-cde0-44bf-8552-2f00b88d549a,network=Network(b529ac7d-1104-4486-92f7-26e249a742d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc797d1f2-cd') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.objects.instance [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lazy-loading 'pci_devices' on Instance uuid 9579e650-53bf-4772-888e-aa95a4108f75 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:06:35 user nova-compute[74963]:   <uuid>9579e650-53bf-4772-888e-aa95a4108f75</uuid>
Nov 30 08:06:35 user nova-compute[74963]:   <name>instance-00000007</name>
Nov 30 08:06:35 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:06:35 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:06:35 user nova-compute[74963]:   <metadata>
Nov 30 08:06:35 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:06:35 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-723473140</nova:name>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:06:35</nova:creationTime>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:06:35 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:06:35 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:owner>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:user uuid="4b12c28a89dc4c5a8148e87d813c9c2d">tempest-VolumesAssistedSnapshotsTest-558289142-project-member</nova:user>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:project uuid="add45f088a414c8d8a602f23e061700d">tempest-VolumesAssistedSnapshotsTest-558289142</nova:project>
Nov 30 08:06:35 user nova-compute[74963]:       </nova:owner>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:06:35 user nova-compute[74963]:       <nova:ports>
Nov 30 08:06:35 user nova-compute[74963]:         <nova:port uuid="c797d1f2-cde0-44bf-8552-2f00b88d549a">
Nov 30 08:06:35 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 08:06:35 user nova-compute[74963]:         </nova:port>
Nov 30 08:06:35 user nova-compute[74963]:       </nova:ports>
Nov 30 08:06:35 user nova-compute[74963]:     </nova:instance>
Nov 30 08:06:35 user nova-compute[74963]:   </metadata>
Nov 30 08:06:35 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:06:35 user nova-compute[74963]:     <system>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="serial">9579e650-53bf-4772-888e-aa95a4108f75</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="uuid">9579e650-53bf-4772-888e-aa95a4108f75</entry>
Nov 30 08:06:35 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:06:35 user nova-compute[74963]:     </system>
Nov 30 08:06:35 user nova-compute[74963]:   </sysinfo>
Nov 30 08:06:35 user nova-compute[74963]:   <os>
Nov 30 08:06:35 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:06:35 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:06:35 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:06:35 user nova-compute[74963]:   </os>
Nov 30 08:06:35 user nova-compute[74963]:   <features>
Nov 30 08:06:35 user nova-compute[74963]:     <acpi/>
Nov 30 08:06:35 user nova-compute[74963]:     <apic/>
Nov 30 08:06:35 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:06:35 user nova-compute[74963]:   </features>
Nov 30 08:06:35 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:06:35 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:06:35 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:06:35 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:06:35 user nova-compute[74963]:   </clock>
Nov 30 08:06:35 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:06:35 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:06:35 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:06:35 user nova-compute[74963]:   </cpu>
Nov 30 08:06:35 user nova-compute[74963]:   <devices>
Nov 30 08:06:35 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:06:35 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:06:35 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk"/>
Nov 30 08:06:35 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:06:35 user nova-compute[74963]:     </disk>
Nov 30 08:06:35 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:06:35 user nova-compute[74963]:       <mac address="fa:16:3e:d5:c5:5e"/>
Nov 30 08:06:35 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:35 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:06:35 user nova-compute[74963]:       <target dev="tapc797d1f2-cd"/>
Nov 30 08:06:35 user nova-compute[74963]:     </interface>
Nov 30 08:06:35 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:06:35 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/console.log" append="off"/>
Nov 30 08:06:35 user nova-compute[74963]:     </serial>
Nov 30 08:06:35 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:06:35 user nova-compute[74963]:     <video>
Nov 30 08:06:35 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:35 user nova-compute[74963]:     </video>
Nov 30 08:06:35 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:06:35 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:06:35 user nova-compute[74963]:     </rng>
Nov 30 08:06:35 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:06:35 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:06:35 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:06:35 user nova-compute[74963]:     </memballoon>
Nov 30 08:06:35 user nova-compute[74963]:   </devices>
Nov 30 08:06:35 user nova-compute[74963]: </domain>
Nov 30 08:06:35 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-723473140',display_name='tempest-VolumesAssistedSnapshotsTest-server-723473140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-723473140',id=7,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFsTyvXtu/UsB8DrK+A7rP5SJ26h/4akhPolxPB5bLWHWZuB2zoFRLdojCee82Bw31AR2vhWBxJY3/ABKqcYRYHCl5LFXVoVLwLr6XM/HtH3+7OczNDfnMozjfNZqiZqw==',key_name='tempest-keypair-977526846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='add45f088a414c8d8a602f23e061700d',ramdisk_id='',reservation_id='r-4ndicz4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-558289142',owner_user_name='tempest-VolumesAssistedSnapshotsTest-558289142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b12c28a89dc4c5a8148e87d813c9c2d',uuid=9579e650-53bf-4772-888e-aa95a4108f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Converting VIF {"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:c5:5e,bridge_name='br-int',has_traffic_filtering=True,id=c797d1f2-cde0-44bf-8552-2f00b88d549a,network=Network(b529ac7d-1104-4486-92f7-26e249a742d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc797d1f2-cd') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG os_vif [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:c5:5e,bridge_name='br-int',has_traffic_filtering=True,id=c797d1f2-cde0-44bf-8552-2f00b88d549a,network=Network(b529ac7d-1104-4486-92f7-26e249a742d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc797d1f2-cd') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c14822e5-5500-5cd3-b53d-653f70ec40ac', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc797d1f2-cd, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc797d1f2-cd, col_values=(('qos', UUID('3427fcd7-8021-4f49-96ae-d8d9c9f725f9')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc797d1f2-cd, col_values=(('external_ids', {'iface-id': 'c797d1f2-cde0-44bf-8552-2f00b88d549a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:c5:5e', 'vm-uuid': '9579e650-53bf-4772-888e-aa95a4108f75'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:36 user nova-compute[74963]: INFO os_vif [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:c5:5e,bridge_name='br-int',has_traffic_filtering=True,id=c797d1f2-cde0-44bf-8552-2f00b88d549a,network=Network(b529ac7d-1104-4486-92f7-26e249a742d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc797d1f2-cd')
Nov 30 08:06:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] No VIF found with MAC fa:16:3e:d5:c5:5e, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:06:36 user nova-compute[74963]: DEBUG nova.network.neutron [req-23facb9d-0784-4e24-9c86-de63843b201f req-bdc44bcc-853a-418c-bd74-5a9ea42f8ec3 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Updated VIF entry in instance network info cache for port c797d1f2-cde0-44bf-8552-2f00b88d549a. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:06:36 user nova-compute[74963]: DEBUG nova.network.neutron [req-23facb9d-0784-4e24-9c86-de63843b201f req-bdc44bcc-853a-418c-bd74-5a9ea42f8ec3 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Updating instance_info_cache with network_info: [{"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-23facb9d-0784-4e24-9c86-de63843b201f req-bdc44bcc-853a-418c-bd74-5a9ea42f8ec3 service nova] Releasing lock "refresh_cache-9579e650-53bf-4772-888e-aa95a4108f75" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Successfully updated port: 662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquired lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-8fedbdbd-2881-4898-accc-8ec82f7f6cd5 req-90f9f2b6-6c6a-4a3c-b03f-03b32d9f4b95 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-changed-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-8fedbdbd-2881-4898-accc-8ec82f7f6cd5 req-90f9f2b6-6c6a-4a3c-b03f-03b32d9f4b95 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Refreshing instance network info cache due to event network-changed-662f4120-2ba1-466d-81b6-212565a16a9d. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8fedbdbd-2881-4898-accc-8ec82f7f6cd5 req-90f9f2b6-6c6a-4a3c-b03f-03b32d9f4b95 service nova] Acquiring lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updating instance_info_cache with network_info: [{"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Releasing lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Instance network_info: |[{"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8fedbdbd-2881-4898-accc-8ec82f7f6cd5 req-90f9f2b6-6c6a-4a3c-b03f-03b32d9f4b95 service nova] Acquired lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.network.neutron [req-8fedbdbd-2881-4898-accc-8ec82f7f6cd5 req-90f9f2b6-6c6a-4a3c-b03f-03b32d9f4b95 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Refreshing network info cache for port 662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Start _get_guest_xml network_info=[{"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:06:37 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:37 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560530600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560530600',id=8,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIIMB50S1UrUdAIYurXG++T+DeKVYav11Y2BaKQ3ngEyQM/V5KCBuxUZ9zN/R/zlOKWamLw2XB6+Vkj/xUqSM+aCM6/ySzgbLvOn3nCdOOw3/wxulg0yoXKpuiKCLYag==',key_name='tempest-keypair-1537203754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069409ef36774791b13e4a3eec8d6648',ramdisk_id='',reservation_id='r-zjozxt7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-834159471',owner_user_name='tempest-TaggedAttachmentsTest-834159471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='644095bd2e894f0db86ed3a7d1a06c7a',uuid=6fec797d-1752-464f-8e89-3f1b21cda724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converting VIF {"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:ec,bridge_name='br-int',has_traffic_filtering=True,id=662f4120-2ba1-466d-81b6-212565a16a9d,network=Network(4a32cfd7-b44e-4423-a4cf-201ebd2800be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662f4120-2b') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:06:37 user nova-compute[74963]:   <uuid>6fec797d-1752-464f-8e89-3f1b21cda724</uuid>
Nov 30 08:06:37 user nova-compute[74963]:   <name>instance-00000008</name>
Nov 30 08:06:37 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:06:37 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:06:37 user nova-compute[74963]:   <metadata>
Nov 30 08:06:37 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:06:37 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:06:37 user nova-compute[74963]:       <nova:name>tempest-device-tagging-server-1560530600</nova:name>
Nov 30 08:06:37 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:06:37</nova:creationTime>
Nov 30 08:06:37 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:06:37 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:06:37 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:06:37 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:06:37 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:06:37 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:06:37 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:06:37 user nova-compute[74963]:       <nova:owner>
Nov 30 08:06:37 user nova-compute[74963]:         <nova:user uuid="644095bd2e894f0db86ed3a7d1a06c7a">tempest-TaggedAttachmentsTest-834159471-project-member</nova:user>
Nov 30 08:06:37 user nova-compute[74963]:         <nova:project uuid="069409ef36774791b13e4a3eec8d6648">tempest-TaggedAttachmentsTest-834159471</nova:project>
Nov 30 08:06:37 user nova-compute[74963]:       </nova:owner>
Nov 30 08:06:37 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:06:37 user nova-compute[74963]:       <nova:ports>
Nov 30 08:06:37 user nova-compute[74963]:         <nova:port uuid="662f4120-2ba1-466d-81b6-212565a16a9d">
Nov 30 08:06:37 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:06:37 user nova-compute[74963]:         </nova:port>
Nov 30 08:06:37 user nova-compute[74963]:       </nova:ports>
Nov 30 08:06:37 user nova-compute[74963]:     </nova:instance>
Nov 30 08:06:37 user nova-compute[74963]:   </metadata>
Nov 30 08:06:37 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:06:37 user nova-compute[74963]:     <system>
Nov 30 08:06:37 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:06:37 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:06:37 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:06:37 user nova-compute[74963]:       <entry name="serial">6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:06:37 user nova-compute[74963]:       <entry name="uuid">6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:06:37 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:06:37 user nova-compute[74963]:     </system>
Nov 30 08:06:37 user nova-compute[74963]:   </sysinfo>
Nov 30 08:06:37 user nova-compute[74963]:   <os>
Nov 30 08:06:37 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:06:37 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:06:37 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:06:37 user nova-compute[74963]:   </os>
Nov 30 08:06:37 user nova-compute[74963]:   <features>
Nov 30 08:06:37 user nova-compute[74963]:     <acpi/>
Nov 30 08:06:37 user nova-compute[74963]:     <apic/>
Nov 30 08:06:37 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:06:37 user nova-compute[74963]:   </features>
Nov 30 08:06:37 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:06:37 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:06:37 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:06:37 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:06:37 user nova-compute[74963]:   </clock>
Nov 30 08:06:37 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:06:37 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:06:37 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:06:37 user nova-compute[74963]:   </cpu>
Nov 30 08:06:37 user nova-compute[74963]:   <devices>
Nov 30 08:06:37 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:06:37 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:06:37 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk"/>
Nov 30 08:06:37 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:06:37 user nova-compute[74963]:     </disk>
Nov 30 08:06:37 user nova-compute[74963]:     <disk type="file" device="cdrom">
Nov 30 08:06:37 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 08:06:37 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.config"/>
Nov 30 08:06:37 user nova-compute[74963]:       <target dev="hda" bus="ide"/>
Nov 30 08:06:37 user nova-compute[74963]:     </disk>
Nov 30 08:06:37 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:06:37 user nova-compute[74963]:       <mac address="fa:16:3e:15:71:ec"/>
Nov 30 08:06:37 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:37 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:06:37 user nova-compute[74963]:       <target dev="tap662f4120-2b"/>
Nov 30 08:06:37 user nova-compute[74963]:     </interface>
Nov 30 08:06:37 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:06:37 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log" append="off"/>
Nov 30 08:06:37 user nova-compute[74963]:     </serial>
Nov 30 08:06:37 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:06:37 user nova-compute[74963]:     <video>
Nov 30 08:06:37 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:06:37 user nova-compute[74963]:     </video>
Nov 30 08:06:37 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:06:37 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:06:37 user nova-compute[74963]:     </rng>
Nov 30 08:06:37 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:06:37 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:06:37 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:06:37 user nova-compute[74963]:     </memballoon>
Nov 30 08:06:37 user nova-compute[74963]:   </devices>
Nov 30 08:06:37 user nova-compute[74963]: </domain>
Nov 30 08:06:37 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560530600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560530600',id=8,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIIMB50S1UrUdAIYurXG++T+DeKVYav11Y2BaKQ3ngEyQM/V5KCBuxUZ9zN/R/zlOKWamLw2XB6+Vkj/xUqSM+aCM6/ySzgbLvOn3nCdOOw3/wxulg0yoXKpuiKCLYag==',key_name='tempest-keypair-1537203754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069409ef36774791b13e4a3eec8d6648',ramdisk_id='',reservation_id='r-zjozxt7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-834159471',owner_user_name='tempest-TaggedAttachmentsTest-834159471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='644095bd2e894f0db86ed3a7d1a06c7a',uuid=6fec797d-1752-464f-8e89-3f1b21cda724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converting VIF {"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:ec,bridge_name='br-int',has_traffic_filtering=True,id=662f4120-2ba1-466d-81b6-212565a16a9d,network=Network(4a32cfd7-b44e-4423-a4cf-201ebd2800be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662f4120-2b') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG os_vif [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:ec,bridge_name='br-int',has_traffic_filtering=True,id=662f4120-2ba1-466d-81b6-212565a16a9d,network=Network(4a32cfd7-b44e-4423-a4cf-201ebd2800be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662f4120-2b') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d1610d1-1962-55a9-a2d7-b28f09945cf3', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap662f4120-2b, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap662f4120-2b, col_values=(('qos', UUID('2f52f802-99a7-4712-9ced-dec54537d4c0')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap662f4120-2b, col_values=(('external_ids', {'iface-id': '662f4120-2ba1-466d-81b6-212565a16a9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:71:ec', 'vm-uuid': '6fec797d-1752-464f-8e89-3f1b21cda724'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:37 user nova-compute[74963]: INFO os_vif [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:ec,bridge_name='br-int',has_traffic_filtering=True,id=662f4120-2ba1-466d-81b6-212565a16a9d,network=Network(4a32cfd7-b44e-4423-a4cf-201ebd2800be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662f4120-2b')
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:06:37 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Instance spawned successfully.
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] No BDM found with device name hda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:06:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] No VIF found with MAC fa:16:3e:15:71:ec, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:06:37 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Using config drive
Nov 30 08:06:38 user nova-compute[74963]: INFO nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Took 10.87 seconds to spawn the instance on the hypervisor.
Nov 30 08:06:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:06:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:38 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Creating config drive at /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.config
Nov 30 08:06:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5789nwz6 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:38 user nova-compute[74963]: INFO nova.compute.manager [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Took 12.75 seconds to build instance.
Nov 30 08:06:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5789nwz6" returned: 0 in 0.088s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:38 user nova-compute[74963]: DEBUG nova.network.neutron [req-8fedbdbd-2881-4898-accc-8ec82f7f6cd5 req-90f9f2b6-6c6a-4a3c-b03f-03b32d9f4b95 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updated VIF entry in instance network info cache for port 662f4120-2ba1-466d-81b6-212565a16a9d. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:06:38 user nova-compute[74963]: DEBUG nova.network.neutron [req-8fedbdbd-2881-4898-accc-8ec82f7f6cd5 req-90f9f2b6-6c6a-4a3c-b03f-03b32d9f4b95 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updating instance_info_cache with network_info: [{"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac797612-341e-4116-b10e-352e263ba0a1 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.206s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8fedbdbd-2881-4898-accc-8ec82f7f6cd5 req-90f9f2b6-6c6a-4a3c-b03f-03b32d9f4b95 service nova] Releasing lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-ce396286-e0be-499a-8bb7-c4150286509d req-c6708dde-e372-47ae-8eb8-036b577532ee service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received event network-vif-plugged-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ce396286-e0be-499a-8bb7-c4150286509d req-c6708dde-e372-47ae-8eb8-036b577532ee service nova] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ce396286-e0be-499a-8bb7-c4150286509d req-c6708dde-e372-47ae-8eb8-036b577532ee service nova] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ce396286-e0be-499a-8bb7-c4150286509d req-c6708dde-e372-47ae-8eb8-036b577532ee service nova] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-ce396286-e0be-499a-8bb7-c4150286509d req-c6708dde-e372-47ae-8eb8-036b577532ee service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] No waiting events found dispatching network-vif-plugged-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:41 user nova-compute[74963]: WARNING nova.compute.manager [req-ce396286-e0be-499a-8bb7-c4150286509d req-c6708dde-e372-47ae-8eb8-036b577532ee service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received unexpected event network-vif-plugged-c797d1f2-cde0-44bf-8552-2f00b88d549a for instance with vm_state building and task_state spawning.
Nov 30 08:06:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-69ff3d1a-15fe-40d2-aa81-984ad9e3ed36 req-45881ecd-bd2f-44cb-a7de-dd28e31df4b8 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-plugged-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-69ff3d1a-15fe-40d2-aa81-984ad9e3ed36 req-45881ecd-bd2f-44cb-a7de-dd28e31df4b8 service nova] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-69ff3d1a-15fe-40d2-aa81-984ad9e3ed36 req-45881ecd-bd2f-44cb-a7de-dd28e31df4b8 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-69ff3d1a-15fe-40d2-aa81-984ad9e3ed36 req-45881ecd-bd2f-44cb-a7de-dd28e31df4b8 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-69ff3d1a-15fe-40d2-aa81-984ad9e3ed36 req-45881ecd-bd2f-44cb-a7de-dd28e31df4b8 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] No waiting events found dispatching network-vif-plugged-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:42 user nova-compute[74963]: WARNING nova.compute.manager [req-69ff3d1a-15fe-40d2-aa81-984ad9e3ed36 req-45881ecd-bd2f-44cb-a7de-dd28e31df4b8 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received unexpected event network-vif-plugged-662f4120-2ba1-466d-81b6-212565a16a9d for instance with vm_state building and task_state spawning.
Nov 30 08:06:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-d583d165-4f5e-4dbd-9c40-427b13bf3aba req-e78c6adf-5da4-45bf-9038-d81850e39e39 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d583d165-4f5e-4dbd-9c40-427b13bf3aba req-e78c6adf-5da4-45bf-9038-d81850e39e39 service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d583d165-4f5e-4dbd-9c40-427b13bf3aba req-e78c6adf-5da4-45bf-9038-d81850e39e39 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d583d165-4f5e-4dbd-9c40-427b13bf3aba req-e78c6adf-5da4-45bf-9038-d81850e39e39 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-d583d165-4f5e-4dbd-9c40-427b13bf3aba req-e78c6adf-5da4-45bf-9038-d81850e39e39 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:42 user nova-compute[74963]: WARNING nova.compute.manager [req-d583d165-4f5e-4dbd-9c40-427b13bf3aba req-e78c6adf-5da4-45bf-9038-d81850e39e39 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state active and task_state None.
Nov 30 08:06:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-d76ffe80-4f6f-4507-a654-c493eb1b94b4 req-63188305-ebd1-443e-bc28-a94937555865 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received event network-vif-plugged-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d76ffe80-4f6f-4507-a654-c493eb1b94b4 req-63188305-ebd1-443e-bc28-a94937555865 service nova] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d76ffe80-4f6f-4507-a654-c493eb1b94b4 req-63188305-ebd1-443e-bc28-a94937555865 service nova] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d76ffe80-4f6f-4507-a654-c493eb1b94b4 req-63188305-ebd1-443e-bc28-a94937555865 service nova] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-d76ffe80-4f6f-4507-a654-c493eb1b94b4 req-63188305-ebd1-443e-bc28-a94937555865 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] No waiting events found dispatching network-vif-plugged-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:43 user nova-compute[74963]: WARNING nova.compute.manager [req-d76ffe80-4f6f-4507-a654-c493eb1b94b4 req-63188305-ebd1-443e-bc28-a94937555865 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received unexpected event network-vif-plugged-c797d1f2-cde0-44bf-8552-2f00b88d549a for instance with vm_state building and task_state spawning.
Nov 30 08:06:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-86d57a1a-03b8-4636-b438-e8fb591f51c4 req-f26a6467-1019-4a8d-a99f-1a99fa9fe3a5 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-plugged-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-86d57a1a-03b8-4636-b438-e8fb591f51c4 req-f26a6467-1019-4a8d-a99f-1a99fa9fe3a5 service nova] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-86d57a1a-03b8-4636-b438-e8fb591f51c4 req-f26a6467-1019-4a8d-a99f-1a99fa9fe3a5 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-86d57a1a-03b8-4636-b438-e8fb591f51c4 req-f26a6467-1019-4a8d-a99f-1a99fa9fe3a5 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-86d57a1a-03b8-4636-b438-e8fb591f51c4 req-f26a6467-1019-4a8d-a99f-1a99fa9fe3a5 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] No waiting events found dispatching network-vif-plugged-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:44 user nova-compute[74963]: WARNING nova.compute.manager [req-86d57a1a-03b8-4636-b438-e8fb591f51c4 req-f26a6467-1019-4a8d-a99f-1a99fa9fe3a5 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received unexpected event network-vif-plugged-662f4120-2ba1-466d-81b6-212565a16a9d for instance with vm_state building and task_state spawning.
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:06:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Instance spawned successfully.
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:44 user nova-compute[74963]: WARNING nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state active and task_state None.
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received event network-vif-plugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Acquiring lock "68bcb314-8197-4fe6-b986-b2554c822545-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] No waiting events found dispatching network-vif-plugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:44 user nova-compute[74963]: WARNING nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received unexpected event network-vif-plugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 for instance with vm_state active and task_state None.
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received event network-vif-plugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Acquiring lock "68bcb314-8197-4fe6-b986-b2554c822545-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] No waiting events found dispatching network-vif-plugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:44 user nova-compute[74963]: WARNING nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received unexpected event network-vif-plugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 for instance with vm_state active and task_state None.
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received event network-vif-plugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Acquiring lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] No waiting events found dispatching network-vif-plugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:44 user nova-compute[74963]: WARNING nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received unexpected event network-vif-plugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f for instance with vm_state active and task_state None.
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received event network-vif-plugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Acquiring lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] No waiting events found dispatching network-vif-plugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:44 user nova-compute[74963]: WARNING nova.compute.manager [req-b5f842a4-96ec-4a67-b23a-abbb3581d29b req-8d674931-5fdb-4528-a7bb-c0b0943906ff service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received unexpected event network-vif-plugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f for instance with vm_state active and task_state None.
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:44 user nova-compute[74963]: INFO nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Took 14.16 seconds to spawn the instance on the hypervisor.
Nov 30 08:06:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:06:45 user nova-compute[74963]: INFO nova.compute.manager [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Took 15.57 seconds to build instance.
Nov 30 08:06:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0d773ca0-a994-4e32-a64b-d76d263202b4 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.903s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:06:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Instance spawned successfully.
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:06:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Instance spawned successfully.
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:06:45 user nova-compute[74963]: INFO nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Took 11.34 seconds to spawn the instance on the hypervisor.
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:06:45 user nova-compute[74963]: INFO nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Took 13.06 seconds to spawn the instance on the hypervisor.
Nov 30 08:06:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:06:45 user nova-compute[74963]: INFO nova.compute.manager [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Took 13.22 seconds to build instance.
Nov 30 08:06:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8377d8eb-d5fe-483f-acad-753bdf592859 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.399s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:45 user nova-compute[74963]: INFO nova.compute.manager [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Took 14.81 seconds to build instance.
Nov 30 08:06:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0698bb35-428b-418f-a8be-0f46989ab68c tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "9579e650-53bf-4772-888e-aa95a4108f75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.986s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-d1ee25ba-efba-45e9-937a-2c83f7576628 req-3d764cc6-5dc5-4a2f-9f02-89c4e62e67aa service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received event network-vif-plugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d1ee25ba-efba-45e9-937a-2c83f7576628 req-3d764cc6-5dc5-4a2f-9f02-89c4e62e67aa service nova] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d1ee25ba-efba-45e9-937a-2c83f7576628 req-3d764cc6-5dc5-4a2f-9f02-89c4e62e67aa service nova] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d1ee25ba-efba-45e9-937a-2c83f7576628 req-3d764cc6-5dc5-4a2f-9f02-89c4e62e67aa service nova] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-d1ee25ba-efba-45e9-937a-2c83f7576628 req-3d764cc6-5dc5-4a2f-9f02-89c4e62e67aa service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] No waiting events found dispatching network-vif-plugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:50 user nova-compute[74963]: WARNING nova.compute.manager [req-d1ee25ba-efba-45e9-937a-2c83f7576628 req-3d764cc6-5dc5-4a2f-9f02-89c4e62e67aa service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received unexpected event network-vif-plugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 for instance with vm_state active and task_state None.
Nov 30 08:06:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] There are 0 instances to clean {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74963) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 08:06:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received event network-vif-plugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] No waiting events found dispatching network-vif-plugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:52 user nova-compute[74963]: WARNING nova.compute.manager [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received unexpected event network-vif-plugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 for instance with vm_state active and task_state None.
Nov 30 08:06:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received event network-vif-plugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] No waiting events found dispatching network-vif-plugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:52 user nova-compute[74963]: WARNING nova.compute.manager [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received unexpected event network-vif-plugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 for instance with vm_state active and task_state None.
Nov 30 08:06:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received event network-vif-plugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] No waiting events found dispatching network-vif-plugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:06:52 user nova-compute[74963]: WARNING nova.compute.manager [req-cb48229e-1b42-41ae-87dd-d1fe794eb2d3 req-1f1231d3-1734-42f7-ae5d-90ad495e2924 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received unexpected event network-vif-plugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 for instance with vm_state active and task_state None.
Nov 30 08:06:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:53 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:06:53 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:06:53 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:06:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:54 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:06:54 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:06:54 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:06:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:06:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:06:54 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:06:54 user nova-compute[74963]: DEBUG nova.objects.instance [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lazy-loading 'info_cache' on Instance uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:06:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:06:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:06:59 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:59 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:06:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7661MB free_disk=25.700115203857422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:06:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:06:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 3551893b-4a59-4e6a-a961-8ea6d671632e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 12839e0a-b601-49f3-910e-fb41627ba2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 25afcf51-de30-4a53-bb6b-3e7037f5e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 98e1c4f0-b628-435a-bf98-f814fa927873 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9579e650-53bf-4772-888e-aa95a4108f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 6fec797d-1752-464f-8e89-3f1b21cda724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing inventories for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating ProviderTree inventory for provider 41961ac9-576a-4a02-a5e7-459f54657b3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating inventory in ProviderTree for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing aggregate associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, aggregates: None {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing trait associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:07:00 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:07:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:07:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.111s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:07:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:07:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:07:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:07:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:07:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:22 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:07:24 user nova-compute[74963]: INFO nova.compute.claims [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Claim successful on node user
Nov 30 08:07:24 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:07:25 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:07:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG nova.policy [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24e41bc83b6c4ef0ae36f1085fa75554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2399f81c098498698d655488b497fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:07:25 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Creating image(s)
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "/opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "/opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk 1073741824" returned: 0 in 0.054s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.208s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:07:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Successfully created port: 50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Cannot resize image /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Ensure instance console log exists: /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Successfully updated port: 50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "refresh_cache-7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquired lock "refresh_cache-7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-42f7f305-d6ae-40e1-8fd1-f7f2779519c2 req-8b38be58-1cd4-4910-8349-74c01809ff89 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received event network-changed-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-42f7f305-d6ae-40e1-8fd1-f7f2779519c2 req-8b38be58-1cd4-4910-8349-74c01809ff89 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Refreshing instance network info cache due to event network-changed-50c595ec-df34-4a59-9cce-177d50b6aa06. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-42f7f305-d6ae-40e1-8fd1-f7f2779519c2 req-8b38be58-1cd4-4910-8349-74c01809ff89 service nova] Acquiring lock "refresh_cache-7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:07:26 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Updating instance_info_cache with network_info: [{"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Releasing lock "refresh_cache-7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Instance network_info: |[{"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-42f7f305-d6ae-40e1-8fd1-f7f2779519c2 req-8b38be58-1cd4-4910-8349-74c01809ff89 service nova] Acquired lock "refresh_cache-7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.network.neutron [req-42f7f305-d6ae-40e1-8fd1-f7f2779519c2 req-8b38be58-1cd4-4910-8349-74c01809ff89 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Refreshing network info cache for port 50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Start _get_guest_xml network_info=[{"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:07:27 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:07:27 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1009015824',display_name='tempest-TestServerVolumeAttachmentScenario-server-1009015824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1009015824',id=9,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFCMo0VDl1rnUf5w1XylgQgOovhLpohwS2SsNIdhbGPwZq15OpQsIy6/JRo/bQxZKdVVy1E9XI6BGMMBRWv6XuNqIQ369gjmhyVSMEVWU7Rvq1aQmJeR/0IVBlBaVfOKA==',key_name='tempest-keypair-176192562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2399f81c098498698d655488b497fa9',ramdisk_id='',reservation_id='r-8hxhqxb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1886977138',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1886977138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24e41bc83b6c4ef0ae36f1085fa75554',uuid=7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Converting VIF {"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=50c595ec-df34-4a59-9cce-177d50b6aa06,network=Network(d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c595ec-df') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.objects.instance [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:07:27 user nova-compute[74963]:   <uuid>7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c</uuid>
Nov 30 08:07:27 user nova-compute[74963]:   <name>instance-00000009</name>
Nov 30 08:07:27 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:07:27 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:07:27 user nova-compute[74963]:   <metadata>
Nov 30 08:07:27 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:07:27 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:07:27 user nova-compute[74963]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1009015824</nova:name>
Nov 30 08:07:27 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:07:27</nova:creationTime>
Nov 30 08:07:27 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:07:27 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:07:27 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:07:27 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:07:27 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:07:27 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:07:27 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:07:27 user nova-compute[74963]:       <nova:owner>
Nov 30 08:07:27 user nova-compute[74963]:         <nova:user uuid="24e41bc83b6c4ef0ae36f1085fa75554">tempest-TestServerVolumeAttachmentScenario-1886977138-project-member</nova:user>
Nov 30 08:07:27 user nova-compute[74963]:         <nova:project uuid="c2399f81c098498698d655488b497fa9">tempest-TestServerVolumeAttachmentScenario-1886977138</nova:project>
Nov 30 08:07:27 user nova-compute[74963]:       </nova:owner>
Nov 30 08:07:27 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:07:27 user nova-compute[74963]:       <nova:ports>
Nov 30 08:07:27 user nova-compute[74963]:         <nova:port uuid="50c595ec-df34-4a59-9cce-177d50b6aa06">
Nov 30 08:07:27 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 08:07:27 user nova-compute[74963]:         </nova:port>
Nov 30 08:07:27 user nova-compute[74963]:       </nova:ports>
Nov 30 08:07:27 user nova-compute[74963]:     </nova:instance>
Nov 30 08:07:27 user nova-compute[74963]:   </metadata>
Nov 30 08:07:27 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:07:27 user nova-compute[74963]:     <system>
Nov 30 08:07:27 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:07:27 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:07:27 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:07:27 user nova-compute[74963]:       <entry name="serial">7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c</entry>
Nov 30 08:07:27 user nova-compute[74963]:       <entry name="uuid">7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c</entry>
Nov 30 08:07:27 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:07:27 user nova-compute[74963]:     </system>
Nov 30 08:07:27 user nova-compute[74963]:   </sysinfo>
Nov 30 08:07:27 user nova-compute[74963]:   <os>
Nov 30 08:07:27 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:07:27 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:07:27 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:07:27 user nova-compute[74963]:   </os>
Nov 30 08:07:27 user nova-compute[74963]:   <features>
Nov 30 08:07:27 user nova-compute[74963]:     <acpi/>
Nov 30 08:07:27 user nova-compute[74963]:     <apic/>
Nov 30 08:07:27 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:07:27 user nova-compute[74963]:   </features>
Nov 30 08:07:27 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:07:27 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:07:27 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:07:27 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:07:27 user nova-compute[74963]:   </clock>
Nov 30 08:07:27 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:07:27 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:07:27 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:07:27 user nova-compute[74963]:   </cpu>
Nov 30 08:07:27 user nova-compute[74963]:   <devices>
Nov 30 08:07:27 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:07:27 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:07:27 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk"/>
Nov 30 08:07:27 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:07:27 user nova-compute[74963]:     </disk>
Nov 30 08:07:27 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:07:27 user nova-compute[74963]:       <mac address="fa:16:3e:3b:ec:0f"/>
Nov 30 08:07:27 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:07:27 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:07:27 user nova-compute[74963]:       <target dev="tap50c595ec-df"/>
Nov 30 08:07:27 user nova-compute[74963]:     </interface>
Nov 30 08:07:27 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:07:27 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/console.log" append="off"/>
Nov 30 08:07:27 user nova-compute[74963]:     </serial>
Nov 30 08:07:27 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:07:27 user nova-compute[74963]:     <video>
Nov 30 08:07:27 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:07:27 user nova-compute[74963]:     </video>
Nov 30 08:07:27 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:07:27 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:07:27 user nova-compute[74963]:     </rng>
Nov 30 08:07:27 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:07:27 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:07:27 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:07:27 user nova-compute[74963]:     </memballoon>
Nov 30 08:07:27 user nova-compute[74963]:   </devices>
Nov 30 08:07:27 user nova-compute[74963]: </domain>
Nov 30 08:07:27 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1009015824',display_name='tempest-TestServerVolumeAttachmentScenario-server-1009015824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1009015824',id=9,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFCMo0VDl1rnUf5w1XylgQgOovhLpohwS2SsNIdhbGPwZq15OpQsIy6/JRo/bQxZKdVVy1E9XI6BGMMBRWv6XuNqIQ369gjmhyVSMEVWU7Rvq1aQmJeR/0IVBlBaVfOKA==',key_name='tempest-keypair-176192562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2399f81c098498698d655488b497fa9',ramdisk_id='',reservation_id='r-8hxhqxb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1886977138',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1886977138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24e41bc83b6c4ef0ae36f1085fa75554',uuid=7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Converting VIF {"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=50c595ec-df34-4a59-9cce-177d50b6aa06,network=Network(d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c595ec-df') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG os_vif [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=50c595ec-df34-4a59-9cce-177d50b6aa06,network=Network(d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c595ec-df') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38d4d8d5-895e-5c51-a906-fbc57ffed4c6', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50c595ec-df, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50c595ec-df, col_values=(('qos', UUID('5ce17b6b-4dfa-456f-aa42-c2fae16bbd2c')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50c595ec-df, col_values=(('external_ids', {'iface-id': '50c595ec-df34-4a59-9cce-177d50b6aa06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ec:0f', 'vm-uuid': '7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:27 user nova-compute[74963]: INFO os_vif [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=50c595ec-df34-4a59-9cce-177d50b6aa06,network=Network(d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c595ec-df')
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] No VIF found with MAC fa:16:3e:3b:ec:0f, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.network.neutron [req-42f7f305-d6ae-40e1-8fd1-f7f2779519c2 req-8b38be58-1cd4-4910-8349-74c01809ff89 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Updated VIF entry in instance network info cache for port 50c595ec-df34-4a59-9cce-177d50b6aa06. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG nova.network.neutron [req-42f7f305-d6ae-40e1-8fd1-f7f2779519c2 req-8b38be58-1cd4-4910-8349-74c01809ff89 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Updating instance_info_cache with network_info: [{"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:07:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-42f7f305-d6ae-40e1-8fd1-f7f2779519c2 req-8b38be58-1cd4-4910-8349-74c01809ff89 service nova] Releasing lock "refresh_cache-7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:07:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:29 user nova-compute[74963]: DEBUG nova.compute.manager [req-ce95abb9-7d37-43ec-99a7-253210682a25 req-bc95ee45-fe32-4592-b972-260d448c2b53 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received event network-vif-plugged-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:07:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ce95abb9-7d37-43ec-99a7-253210682a25 req-bc95ee45-fe32-4592-b972-260d448c2b53 service nova] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ce95abb9-7d37-43ec-99a7-253210682a25 req-bc95ee45-fe32-4592-b972-260d448c2b53 service nova] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ce95abb9-7d37-43ec-99a7-253210682a25 req-bc95ee45-fe32-4592-b972-260d448c2b53 service nova] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:29 user nova-compute[74963]: DEBUG nova.compute.manager [req-ce95abb9-7d37-43ec-99a7-253210682a25 req-bc95ee45-fe32-4592-b972-260d448c2b53 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] No waiting events found dispatching network-vif-plugged-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:07:29 user nova-compute[74963]: WARNING nova.compute.manager [req-ce95abb9-7d37-43ec-99a7-253210682a25 req-bc95ee45-fe32-4592-b972-260d448c2b53 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received unexpected event network-vif-plugged-50c595ec-df34-4a59-9cce-177d50b6aa06 for instance with vm_state building and task_state spawning.
Nov 30 08:07:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:07:31 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Instance spawned successfully.
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:07:31 user nova-compute[74963]: INFO nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:07:31 user nova-compute[74963]: INFO nova.compute.claims [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Claim successful on node user
Nov 30 08:07:31 user nova-compute[74963]: INFO nova.compute.manager [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Took 6.87 seconds to build instance.
Nov 30 08:07:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7e781d87-6f0f-4c5f-9194-0fca6d7ea03c tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.992s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.compute.manager [req-18c62257-d7bf-4cdf-aabf-bc6a7047ea98 req-6e98716a-29a7-4be6-a501-0b32555e3cbb service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received event network-vif-plugged-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-18c62257-d7bf-4cdf-aabf-bc6a7047ea98 req-6e98716a-29a7-4be6-a501-0b32555e3cbb service nova] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-18c62257-d7bf-4cdf-aabf-bc6a7047ea98 req-6e98716a-29a7-4be6-a501-0b32555e3cbb service nova] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-18c62257-d7bf-4cdf-aabf-bc6a7047ea98 req-6e98716a-29a7-4be6-a501-0b32555e3cbb service nova] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.compute.manager [req-18c62257-d7bf-4cdf-aabf-bc6a7047ea98 req-6e98716a-29a7-4be6-a501-0b32555e3cbb service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] No waiting events found dispatching network-vif-plugged-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:07:31 user nova-compute[74963]: WARNING nova.compute.manager [req-18c62257-d7bf-4cdf-aabf-bc6a7047ea98 req-6e98716a-29a7-4be6-a501-0b32555e3cbb service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received unexpected event network-vif-plugged-50c595ec-df34-4a59-9cce-177d50b6aa06 for instance with vm_state active and task_state None.
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:07:31 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:07:31 user nova-compute[74963]: DEBUG nova.policy [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f7d6cf12bef4415b2224ceb856b936f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe7a6cc402a4902ba3498b71ae52018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:07:32 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Creating image(s)
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "/opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "/opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "/opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.249s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.209s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk 1073741824" returned: 0 in 0.056s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Successfully created port: 53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Cannot resize image /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Ensure instance console log exists: /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Successfully updated port: 53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquired lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-95ef7a3d-a1a5-4ca9-8491-cf14f3eb8f33 req-fbf536f3-a9cc-4b35-b5b0-42942309a8a9 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received event network-changed-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-95ef7a3d-a1a5-4ca9-8491-cf14f3eb8f33 req-fbf536f3-a9cc-4b35-b5b0-42942309a8a9 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Refreshing instance network info cache due to event network-changed-53d952b1-3f88-45a5-9298-3d37b9335974. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-95ef7a3d-a1a5-4ca9-8491-cf14f3eb8f33 req-fbf536f3-a9cc-4b35-b5b0-42942309a8a9 service nova] Acquiring lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating instance_info_cache with network_info: [{"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Releasing lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Instance network_info: |[{"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-95ef7a3d-a1a5-4ca9-8491-cf14f3eb8f33 req-fbf536f3-a9cc-4b35-b5b0-42942309a8a9 service nova] Acquired lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.network.neutron [req-95ef7a3d-a1a5-4ca9-8491-cf14f3eb8f33 req-fbf536f3-a9cc-4b35-b5b0-42942309a8a9 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Refreshing network info cache for port 53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Start _get_guest_xml network_info=[{"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:07:33 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:07:33 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-316819850',display_name='tempest-SnapshotDataIntegrityTests-server-316819850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-316819850',id=10,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3vuDCtEa1Plhn0HcBj0ArjNQrQT23hi/GFcg61YUdhljzG+/1uq68hZRArOxttUnSYNftHfwsUJn8XpWBm7pncT2UHfF2DOQomQM4ZgwNGQggPoMsnnWjAiHH0pXb7DQ==',key_name='tempest-keypair-314152562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfe7a6cc402a4902ba3498b71ae52018',ramdisk_id='',reservation_id='r-vc46nq40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1083476417',owner_user_name='tempest-SnapshotDataIntegrityTests-1083476417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7d6cf12bef4415b2224ceb856b936f',uuid=67d99f85-78de-4702-aa55-758173230187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Converting VIF {"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=53d952b1-3f88-45a5-9298-3d37b9335974,network=Network(ed0554b6-2198-4d86-83f6-71519e26610e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d952b1-3f') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.objects.instance [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'pci_devices' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:07:33 user nova-compute[74963]:   <uuid>67d99f85-78de-4702-aa55-758173230187</uuid>
Nov 30 08:07:33 user nova-compute[74963]:   <name>instance-0000000a</name>
Nov 30 08:07:33 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:07:33 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:07:33 user nova-compute[74963]:   <metadata>
Nov 30 08:07:33 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:07:33 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:07:33 user nova-compute[74963]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-316819850</nova:name>
Nov 30 08:07:33 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:07:33</nova:creationTime>
Nov 30 08:07:33 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:07:33 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:07:33 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:07:33 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:07:33 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:07:33 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:07:33 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:07:33 user nova-compute[74963]:       <nova:owner>
Nov 30 08:07:33 user nova-compute[74963]:         <nova:user uuid="0f7d6cf12bef4415b2224ceb856b936f">tempest-SnapshotDataIntegrityTests-1083476417-project-member</nova:user>
Nov 30 08:07:33 user nova-compute[74963]:         <nova:project uuid="bfe7a6cc402a4902ba3498b71ae52018">tempest-SnapshotDataIntegrityTests-1083476417</nova:project>
Nov 30 08:07:33 user nova-compute[74963]:       </nova:owner>
Nov 30 08:07:33 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:07:33 user nova-compute[74963]:       <nova:ports>
Nov 30 08:07:33 user nova-compute[74963]:         <nova:port uuid="53d952b1-3f88-45a5-9298-3d37b9335974">
Nov 30 08:07:33 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 08:07:33 user nova-compute[74963]:         </nova:port>
Nov 30 08:07:33 user nova-compute[74963]:       </nova:ports>
Nov 30 08:07:33 user nova-compute[74963]:     </nova:instance>
Nov 30 08:07:33 user nova-compute[74963]:   </metadata>
Nov 30 08:07:33 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:07:33 user nova-compute[74963]:     <system>
Nov 30 08:07:33 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:07:33 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:07:33 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:07:33 user nova-compute[74963]:       <entry name="serial">67d99f85-78de-4702-aa55-758173230187</entry>
Nov 30 08:07:33 user nova-compute[74963]:       <entry name="uuid">67d99f85-78de-4702-aa55-758173230187</entry>
Nov 30 08:07:33 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:07:33 user nova-compute[74963]:     </system>
Nov 30 08:07:33 user nova-compute[74963]:   </sysinfo>
Nov 30 08:07:33 user nova-compute[74963]:   <os>
Nov 30 08:07:33 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:07:33 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:07:33 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:07:33 user nova-compute[74963]:   </os>
Nov 30 08:07:33 user nova-compute[74963]:   <features>
Nov 30 08:07:33 user nova-compute[74963]:     <acpi/>
Nov 30 08:07:33 user nova-compute[74963]:     <apic/>
Nov 30 08:07:33 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:07:33 user nova-compute[74963]:   </features>
Nov 30 08:07:33 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:07:33 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:07:33 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:07:33 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:07:33 user nova-compute[74963]:   </clock>
Nov 30 08:07:33 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:07:33 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:07:33 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:07:33 user nova-compute[74963]:   </cpu>
Nov 30 08:07:33 user nova-compute[74963]:   <devices>
Nov 30 08:07:33 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:07:33 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:07:33 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk"/>
Nov 30 08:07:33 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:07:33 user nova-compute[74963]:     </disk>
Nov 30 08:07:33 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:07:33 user nova-compute[74963]:       <mac address="fa:16:3e:e2:e7:00"/>
Nov 30 08:07:33 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:07:33 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:07:33 user nova-compute[74963]:       <target dev="tap53d952b1-3f"/>
Nov 30 08:07:33 user nova-compute[74963]:     </interface>
Nov 30 08:07:33 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:07:33 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/console.log" append="off"/>
Nov 30 08:07:33 user nova-compute[74963]:     </serial>
Nov 30 08:07:33 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:07:33 user nova-compute[74963]:     <video>
Nov 30 08:07:33 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:07:33 user nova-compute[74963]:     </video>
Nov 30 08:07:33 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:07:33 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:07:33 user nova-compute[74963]:     </rng>
Nov 30 08:07:33 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:07:33 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:07:33 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:07:33 user nova-compute[74963]:     </memballoon>
Nov 30 08:07:33 user nova-compute[74963]:   </devices>
Nov 30 08:07:33 user nova-compute[74963]: </domain>
Nov 30 08:07:33 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-316819850',display_name='tempest-SnapshotDataIntegrityTests-server-316819850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-316819850',id=10,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3vuDCtEa1Plhn0HcBj0ArjNQrQT23hi/GFcg61YUdhljzG+/1uq68hZRArOxttUnSYNftHfwsUJn8XpWBm7pncT2UHfF2DOQomQM4ZgwNGQggPoMsnnWjAiHH0pXb7DQ==',key_name='tempest-keypair-314152562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfe7a6cc402a4902ba3498b71ae52018',ramdisk_id='',reservation_id='r-vc46nq40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1083476417',owner_user_name='tempest-SnapshotDataIntegrityTests-1083476417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7d6cf12bef4415b2224ceb856b936f',uuid=67d99f85-78de-4702-aa55-758173230187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Converting VIF {"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=53d952b1-3f88-45a5-9298-3d37b9335974,network=Network(ed0554b6-2198-4d86-83f6-71519e26610e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d952b1-3f') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG os_vif [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=53d952b1-3f88-45a5-9298-3d37b9335974,network=Network(ed0554b6-2198-4d86-83f6-71519e26610e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d952b1-3f') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95f37b74-dc89-5163-828b-81df416b5382', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53d952b1-3f, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53d952b1-3f, col_values=(('qos', UUID('2f2bf03c-ce7c-489f-ae61-d9602c99fd33')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53d952b1-3f, col_values=(('external_ids', {'iface-id': '53d952b1-3f88-45a5-9298-3d37b9335974', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:e7:00', 'vm-uuid': '67d99f85-78de-4702-aa55-758173230187'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:07:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:33 user nova-compute[74963]: INFO os_vif [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=53d952b1-3f88-45a5-9298-3d37b9335974,network=Network(ed0554b6-2198-4d86-83f6-71519e26610e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d952b1-3f')
Nov 30 08:07:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:07:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No VIF found with MAC fa:16:3e:e2:e7:00, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:07:34 user nova-compute[74963]: DEBUG nova.network.neutron [req-95ef7a3d-a1a5-4ca9-8491-cf14f3eb8f33 req-fbf536f3-a9cc-4b35-b5b0-42942309a8a9 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Updated VIF entry in instance network info cache for port 53d952b1-3f88-45a5-9298-3d37b9335974. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:07:34 user nova-compute[74963]: DEBUG nova.network.neutron [req-95ef7a3d-a1a5-4ca9-8491-cf14f3eb8f33 req-fbf536f3-a9cc-4b35-b5b0-42942309a8a9 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating instance_info_cache with network_info: [{"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:07:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-95ef7a3d-a1a5-4ca9-8491-cf14f3eb8f33 req-fbf536f3-a9cc-4b35-b5b0-42942309a8a9 service nova] Releasing lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:07:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-3ceecc32-463d-4f2b-b728-4f3593bc394c req-85369a35-9e6e-4d86-a8d3-32e2e4403d16 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received event network-vif-plugged-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:07:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3ceecc32-463d-4f2b-b728-4f3593bc394c req-85369a35-9e6e-4d86-a8d3-32e2e4403d16 service nova] Acquiring lock "67d99f85-78de-4702-aa55-758173230187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3ceecc32-463d-4f2b-b728-4f3593bc394c req-85369a35-9e6e-4d86-a8d3-32e2e4403d16 service nova] Lock "67d99f85-78de-4702-aa55-758173230187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3ceecc32-463d-4f2b-b728-4f3593bc394c req-85369a35-9e6e-4d86-a8d3-32e2e4403d16 service nova] Lock "67d99f85-78de-4702-aa55-758173230187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-3ceecc32-463d-4f2b-b728-4f3593bc394c req-85369a35-9e6e-4d86-a8d3-32e2e4403d16 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] No waiting events found dispatching network-vif-plugged-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:07:35 user nova-compute[74963]: WARNING nova.compute.manager [req-3ceecc32-463d-4f2b-b728-4f3593bc394c req-85369a35-9e6e-4d86-a8d3-32e2e4403d16 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received unexpected event network-vif-plugged-53d952b1-3f88-45a5-9298-3d37b9335974 for instance with vm_state building and task_state spawning.
Nov 30 08:07:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:07:37 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 67d99f85-78de-4702-aa55-758173230187] Instance spawned successfully.
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-3fe06e14-62de-409e-a483-347ddc6975ea req-45f29802-4ceb-44ef-90c9-cf5dbdf91407 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received event network-vif-plugged-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3fe06e14-62de-409e-a483-347ddc6975ea req-45f29802-4ceb-44ef-90c9-cf5dbdf91407 service nova] Acquiring lock "67d99f85-78de-4702-aa55-758173230187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3fe06e14-62de-409e-a483-347ddc6975ea req-45f29802-4ceb-44ef-90c9-cf5dbdf91407 service nova] Lock "67d99f85-78de-4702-aa55-758173230187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3fe06e14-62de-409e-a483-347ddc6975ea req-45f29802-4ceb-44ef-90c9-cf5dbdf91407 service nova] Lock "67d99f85-78de-4702-aa55-758173230187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-3fe06e14-62de-409e-a483-347ddc6975ea req-45f29802-4ceb-44ef-90c9-cf5dbdf91407 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] No waiting events found dispatching network-vif-plugged-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:07:37 user nova-compute[74963]: WARNING nova.compute.manager [req-3fe06e14-62de-409e-a483-347ddc6975ea req-45f29802-4ceb-44ef-90c9-cf5dbdf91407 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received unexpected event network-vif-plugged-53d952b1-3f88-45a5-9298-3d37b9335974 for instance with vm_state building and task_state spawning.
Nov 30 08:07:37 user nova-compute[74963]: INFO nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 30 08:07:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:07:37 user nova-compute[74963]: INFO nova.compute.manager [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Took 6.61 seconds to build instance.
Nov 30 08:07:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1f193816-d1c3-44e8-a62a-82a27d1fb46e tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.751s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-b0d479ff-5495-4e87-8b8e-3b2f09cab991 req-b44141e8-a39d-4ba6-9781-76fe791d9377 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-changed-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:07:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-b0d479ff-5495-4e87-8b8e-3b2f09cab991 req-b44141e8-a39d-4ba6-9781-76fe791d9377 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Refreshing instance network info cache due to event network-changed-9f867ffa-aeb8-4693-bce5-c4e507fad1a2. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:07:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b0d479ff-5495-4e87-8b8e-3b2f09cab991 req-b44141e8-a39d-4ba6-9781-76fe791d9377 service nova] Acquiring lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:07:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b0d479ff-5495-4e87-8b8e-3b2f09cab991 req-b44141e8-a39d-4ba6-9781-76fe791d9377 service nova] Acquired lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:07:53 user nova-compute[74963]: DEBUG nova.network.neutron [req-b0d479ff-5495-4e87-8b8e-3b2f09cab991 req-b44141e8-a39d-4ba6-9781-76fe791d9377 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Refreshing network info cache for port 9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:07:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG nova.network.neutron [req-b0d479ff-5495-4e87-8b8e-3b2f09cab991 req-b44141e8-a39d-4ba6-9781-76fe791d9377 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updated VIF entry in instance network info cache for port 9f867ffa-aeb8-4693-bce5-c4e507fad1a2. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG nova.network.neutron [req-b0d479ff-5495-4e87-8b8e-3b2f09cab991 req-b44141e8-a39d-4ba6-9781-76fe791d9377 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b0d479ff-5495-4e87-8b8e-3b2f09cab991 req-b44141e8-a39d-4ba6-9781-76fe791d9377 service nova] Releasing lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:56 user nova-compute[74963]: INFO nova.compute.manager [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] instance snapshotting
Nov 30 08:07:56 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Beginning live snapshot process
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json -f qcow2 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json -f qcow2 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.217s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "16fe9479-fdd8-493f-92f9-a59b84af0342" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvs6s9e29/845003e805a64285ab5dd5b51b4b0523.delta 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvs6s9e29/845003e805a64285ab5dd5b51b4b0523.delta 1073741824" returned: 0 in 0.054s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 08:07:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74963) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 30 08:07:57 user nova-compute[74963]: INFO nova.virt.libvirt.host [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] UEFI support detected
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:07:57 user nova-compute[74963]: INFO nova.compute.claims [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Claim successful on node user
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "12839e0a-b601-49f3-910e-fb41627ba2c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:07:58 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 08:07:58 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:07:58 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:07:58 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7091MB free_disk=25.500080108642578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG nova.objects.instance [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lazy-loading 'flavor' on Instance uuid 12839e0a-b601-49f3-910e-fb41627ba2c7 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvs6s9e29/845003e805a64285ab5dd5b51b4b0523.delta /opt/stack/data/nova/instances/snapshots/tmpvs6s9e29/845003e805a64285ab5dd5b51b4b0523 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:58 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.440s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.219s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.network.neutron [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "12839e0a-b601-49f3-910e-fb41627ba2c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:59 user nova-compute[74963]: INFO nova.compute.manager [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Attaching volume 3db01166-674e-435a-b2fe-a62034f133d0 to /dev/vdb
Nov 30 08:07:59 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvs6s9e29/845003e805a64285ab5dd5b51b4b0523.delta /opt/stack/data/nova/instances/snapshots/tmpvs6s9e29/845003e805a64285ab5dd5b51b4b0523" returned: 0 in 0.298s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:59 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Snapshot extracted, beginning image upload
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.policy [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63de4ab983be439488dc30077810b5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e5b724c4d64e9f9900b7bad1c2a00f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 6fec797d-1752-464f-8e89-3f1b21cda724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 16fe9479-fdd8-493f-92f9-a59b84af0342 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 25afcf51-de30-4a53-bb6b-3e7037f5e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 12839e0a-b601-49f3-910e-fb41627ba2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 98e1c4f0-b628-435a-bf98-f814fa927873 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9579e650-53bf-4772-888e-aa95a4108f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 67d99f85-78de-4702-aa55-758173230187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 3551893b-4a59-4e6a-a961-8ea6d671632e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG os_brick.utils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:07:59 user nova-compute[74963]: INFO oslo.privsep.daemon [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmphzydv2wp/privsep.sock']
Nov 30 08:07:59 user sudo[86482]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmphzydv2wp/privsep.sock
Nov 30 08:07:59 user sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:07:59 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Creating image(s)
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "/opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "/opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "/opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.224s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.network.neutron [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Successfully created port: 84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk 1073741824" returned: 0 in 0.056s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:07:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Cannot resize image /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Ensure instance console log exists: /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Successfully updated port: 84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "refresh_cache-16fe9479-fdd8-493f-92f9-a59b84af0342" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquired lock "refresh_cache-16fe9479-fdd8-493f-92f9-a59b84af0342" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-087106a4-9597-4cfc-8ddc-3fa3d6f7efd7 req-416411c3-77d6-4ee9-98dd-3d9ff631ba81 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received event network-changed-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-087106a4-9597-4cfc-8ddc-3fa3d6f7efd7 req-416411c3-77d6-4ee9-98dd-3d9ff631ba81 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Refreshing instance network info cache due to event network-changed-84734d5f-69a9-4621-82ec-c0c1e414c55a. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-087106a4-9597-4cfc-8ddc-3fa3d6f7efd7 req-416411c3-77d6-4ee9-98dd-3d9ff631ba81 service nova] Acquiring lock "refresh_cache-16fe9479-fdd8-493f-92f9-a59b84af0342" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Updating instance_info_cache with network_info: [{"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:00 user sudo[86482]: pam_unix(sudo:session): session closed for user root
Nov 30 08:08:00 user nova-compute[74963]: INFO oslo.privsep.daemon [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Spawned new privsep daemon via rootwrap
Nov 30 08:08:00 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 08:08:00 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 08:08:00 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 30 08:08:00 user nova-compute[74963]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86506
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f83a0da-29ca-4737-9189-560d2abbba4f]: (2,) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Releasing lock "refresh_cache-16fe9479-fdd8-493f-92f9-a59b84af0342" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Instance network_info: |[{"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-087106a4-9597-4cfc-8ddc-3fa3d6f7efd7 req-416411c3-77d6-4ee9-98dd-3d9ff631ba81 service nova] Acquired lock "refresh_cache-16fe9479-fdd8-493f-92f9-a59b84af0342" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.neutron [req-087106a4-9597-4cfc-8ddc-3fa3d6f7efd7 req-416411c3-77d6-4ee9-98dd-3d9ff631ba81 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Refreshing network info cache for port 84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Start _get_guest_xml network_info=[{"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:08:00 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:08:00 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-465738661',display_name='tempest-ServersNegativeTestJSON-server-465738661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-465738661',id=11,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e5b724c4d64e9f9900b7bad1c2a00f',ramdisk_id='',reservation_id='r-8s8q7vw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1755407575',owner_user_name='tempest-ServersNegativeTestJSON-1755407575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:07:59Z,user_data=None,user_id='63de4ab983be439488dc30077810b5f0',uuid=16fe9479-fdd8-493f-92f9-a59b84af0342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converting VIF {"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:fd:bd,bridge_name='br-int',has_traffic_filtering=True,id=84734d5f-69a9-4621-82ec-c0c1e414c55a,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84734d5f-69') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lazy-loading 'pci_devices' on Instance uuid 16fe9479-fdd8-493f-92f9-a59b84af0342 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:08:00 user nova-compute[74963]:   <uuid>16fe9479-fdd8-493f-92f9-a59b84af0342</uuid>
Nov 30 08:08:00 user nova-compute[74963]:   <name>instance-0000000b</name>
Nov 30 08:08:00 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:08:00 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:08:00 user nova-compute[74963]:   <metadata>
Nov 30 08:08:00 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:08:00 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:08:00 user nova-compute[74963]:       <nova:name>tempest-ServersNegativeTestJSON-server-465738661</nova:name>
Nov 30 08:08:00 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:08:00</nova:creationTime>
Nov 30 08:08:00 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:08:00 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:08:00 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:08:00 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:08:00 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:08:00 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:08:00 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:08:00 user nova-compute[74963]:       <nova:owner>
Nov 30 08:08:00 user nova-compute[74963]:         <nova:user uuid="63de4ab983be439488dc30077810b5f0">tempest-ServersNegativeTestJSON-1755407575-project-member</nova:user>
Nov 30 08:08:00 user nova-compute[74963]:         <nova:project uuid="12e5b724c4d64e9f9900b7bad1c2a00f">tempest-ServersNegativeTestJSON-1755407575</nova:project>
Nov 30 08:08:00 user nova-compute[74963]:       </nova:owner>
Nov 30 08:08:00 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:08:00 user nova-compute[74963]:       <nova:ports>
Nov 30 08:08:00 user nova-compute[74963]:         <nova:port uuid="84734d5f-69a9-4621-82ec-c0c1e414c55a">
Nov 30 08:08:00 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:08:00 user nova-compute[74963]:         </nova:port>
Nov 30 08:08:00 user nova-compute[74963]:       </nova:ports>
Nov 30 08:08:00 user nova-compute[74963]:     </nova:instance>
Nov 30 08:08:00 user nova-compute[74963]:   </metadata>
Nov 30 08:08:00 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:08:00 user nova-compute[74963]:     <system>
Nov 30 08:08:00 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:08:00 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:08:00 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:08:00 user nova-compute[74963]:       <entry name="serial">16fe9479-fdd8-493f-92f9-a59b84af0342</entry>
Nov 30 08:08:00 user nova-compute[74963]:       <entry name="uuid">16fe9479-fdd8-493f-92f9-a59b84af0342</entry>
Nov 30 08:08:00 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:08:00 user nova-compute[74963]:     </system>
Nov 30 08:08:00 user nova-compute[74963]:   </sysinfo>
Nov 30 08:08:00 user nova-compute[74963]:   <os>
Nov 30 08:08:00 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:08:00 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:08:00 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:08:00 user nova-compute[74963]:   </os>
Nov 30 08:08:00 user nova-compute[74963]:   <features>
Nov 30 08:08:00 user nova-compute[74963]:     <acpi/>
Nov 30 08:08:00 user nova-compute[74963]:     <apic/>
Nov 30 08:08:00 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:08:00 user nova-compute[74963]:   </features>
Nov 30 08:08:00 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:08:00 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:08:00 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:08:00 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:08:00 user nova-compute[74963]:   </clock>
Nov 30 08:08:00 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:08:00 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:08:00 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:08:00 user nova-compute[74963]:   </cpu>
Nov 30 08:08:00 user nova-compute[74963]:   <devices>
Nov 30 08:08:00 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:08:00 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:08:00 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk"/>
Nov 30 08:08:00 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:08:00 user nova-compute[74963]:     </disk>
Nov 30 08:08:00 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:08:00 user nova-compute[74963]:       <mac address="fa:16:3e:77:fd:bd"/>
Nov 30 08:08:00 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:08:00 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:08:00 user nova-compute[74963]:       <target dev="tap84734d5f-69"/>
Nov 30 08:08:00 user nova-compute[74963]:     </interface>
Nov 30 08:08:00 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:08:00 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/console.log" append="off"/>
Nov 30 08:08:00 user nova-compute[74963]:     </serial>
Nov 30 08:08:00 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:08:00 user nova-compute[74963]:     <video>
Nov 30 08:08:00 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:08:00 user nova-compute[74963]:     </video>
Nov 30 08:08:00 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:08:00 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:08:00 user nova-compute[74963]:     </rng>
Nov 30 08:08:00 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:08:00 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:08:00 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:08:00 user nova-compute[74963]:     </memballoon>
Nov 30 08:08:00 user nova-compute[74963]:   </devices>
Nov 30 08:08:00 user nova-compute[74963]: </domain>
Nov 30 08:08:00 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-465738661',display_name='tempest-ServersNegativeTestJSON-server-465738661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-465738661',id=11,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e5b724c4d64e9f9900b7bad1c2a00f',ramdisk_id='',reservation_id='r-8s8q7vw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1755407575',owner_user_name='tempest-ServersNegativeTestJSON-1755407575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:07:59Z,user_data=None,user_id='63de4ab983be439488dc30077810b5f0',uuid=16fe9479-fdd8-493f-92f9-a59b84af0342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converting VIF {"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:fd:bd,bridge_name='br-int',has_traffic_filtering=True,id=84734d5f-69a9-4621-82ec-c0c1e414c55a,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84734d5f-69') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG os_vif [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:fd:bd,bridge_name='br-int',has_traffic_filtering=True,id=84734d5f-69a9-4621-82ec-c0c1e414c55a,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84734d5f-69') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9ade899-47ed-520d-98c5-617183635024', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84734d5f-69, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84734d5f-69, col_values=(('qos', UUID('f2b882d8-a236-42ea-97e2-134b8b920c20')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84734d5f-69, col_values=(('external_ids', {'iface-id': '84734d5f-69a9-4621-82ec-c0c1e414c55a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:fd:bd', 'vm-uuid': '16fe9479-fdd8-493f-92f9-a59b84af0342'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:01 user nova-compute[74963]: INFO os_vif [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:fd:bd,bridge_name='br-int',has_traffic_filtering=True,id=84734d5f-69a9-4621-82ec-c0c1e414c55a,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84734d5f-69')
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] No VIF found with MAC fa:16:3e:77:fd:bd, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c0e2d-192a-4445-b03e-a03b9316383b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:01 user nova-compute[74963]: WARNING os_brick.initiator.connectors.nvmeof [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de708d-d97e-4051-96d5-336956c4185e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[81484bfb-3581-4c8b-a4c7-6e608f4ac220]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6bc85e-2bd6-4e47-971e-7c78fcdad4fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:01 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ca4f8-9d76-4762-9b34-b39048fed063]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG os_brick.utils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] <== get_connector_properties: return (1917ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Updating existing volume attachment record: 22c10dd7-f6d7-4054-81f9-0a9cbfcf666e {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updating instance_info_cache with network_info: [{"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG nova.network.neutron [req-087106a4-9597-4cfc-8ddc-3fa3d6f7efd7 req-416411c3-77d6-4ee9-98dd-3d9ff631ba81 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Updated VIF entry in instance network info cache for port 84734d5f-69a9-4621-82ec-c0c1e414c55a. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG nova.network.neutron [req-087106a4-9597-4cfc-8ddc-3fa3d6f7efd7 req-416411c3-77d6-4ee9-98dd-3d9ff631ba81 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Updating instance_info_cache with network_info: [{"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-087106a4-9597-4cfc-8ddc-3fa3d6f7efd7 req-416411c3-77d6-4ee9-98dd-3d9ff631ba81 service nova] Releasing lock "refresh_cache-16fe9479-fdd8-493f-92f9-a59b84af0342" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:08:02 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Snapshot image upload complete
Nov 30 08:08:02 user nova-compute[74963]: INFO nova.compute.manager [None req-7d5a3e20-2a94-4d15-9c45-c0101ab29d73 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Took 5.85 seconds to snapshot the instance on the hypervisor.
Nov 30 08:08:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-be35494f-771c-4bd2-8413-90a99aec2429 req-e2860f76-27fb-4cd2-8f77-55e9560ecca1 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received event network-vif-plugged-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-be35494f-771c-4bd2-8413-90a99aec2429 req-e2860f76-27fb-4cd2-8f77-55e9560ecca1 service nova] Acquiring lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-be35494f-771c-4bd2-8413-90a99aec2429 req-e2860f76-27fb-4cd2-8f77-55e9560ecca1 service nova] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-be35494f-771c-4bd2-8413-90a99aec2429 req-e2860f76-27fb-4cd2-8f77-55e9560ecca1 service nova] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-be35494f-771c-4bd2-8413-90a99aec2429 req-e2860f76-27fb-4cd2-8f77-55e9560ecca1 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] No waiting events found dispatching network-vif-plugged-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:08:02 user nova-compute[74963]: WARNING nova.compute.manager [req-be35494f-771c-4bd2-8413-90a99aec2429 req-e2860f76-27fb-4cd2-8f77-55e9560ecca1 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received unexpected event network-vif-plugged-84734d5f-69a9-4621-82ec-c0c1e414c55a for instance with vm_state building and task_state spawning.
Nov 30 08:08:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:08:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Instance spawned successfully.
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-bac81808-c669-4a90-b1cc-38dd6ab15c00 req-095dd0ca-e8d9-4243-a17d-7b086028c552 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received event network-vif-plugged-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bac81808-c669-4a90-b1cc-38dd6ab15c00 req-095dd0ca-e8d9-4243-a17d-7b086028c552 service nova] Acquiring lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bac81808-c669-4a90-b1cc-38dd6ab15c00 req-095dd0ca-e8d9-4243-a17d-7b086028c552 service nova] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bac81808-c669-4a90-b1cc-38dd6ab15c00 req-095dd0ca-e8d9-4243-a17d-7b086028c552 service nova] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-bac81808-c669-4a90-b1cc-38dd6ab15c00 req-095dd0ca-e8d9-4243-a17d-7b086028c552 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] No waiting events found dispatching network-vif-plugged-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:08:04 user nova-compute[74963]: WARNING nova.compute.manager [req-bac81808-c669-4a90-b1cc-38dd6ab15c00 req-095dd0ca-e8d9-4243-a17d-7b086028c552 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received unexpected event network-vif-plugged-84734d5f-69a9-4621-82ec-c0c1e414c55a for instance with vm_state building and task_state spawning.
Nov 30 08:08:04 user nova-compute[74963]: INFO nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 30 08:08:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:08:04 user nova-compute[74963]: INFO nova.compute.manager [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Took 7.26 seconds to build instance.
Nov 30 08:08:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-721fc164-e87a-4ea0-95fe-871c8444c6b0 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.445s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connector [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Factory for ISCSI on None {{(pid=74963) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUmYfJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:11 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:11 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:11 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f11f27-93a8-4b51-a82c-c3c8cf5b4165]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:08:11 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[596704c9-f159-4e63-a11e-1fb8e4dafacc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0] added
Nov 30 08:08:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fe783c-e6a0-4c0f-95ea-176b7fdaa435]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3836fddd-9925-4f3e-8b51-7c00665e3118]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKUmYfJW {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKUmYfJW" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a1981-40be-4247-9d9e-12b0c4da5d0a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKUmYfJW'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ca417b-e807-4ca5-82c0-e9b6f7e53761]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9293e8fc-2e43-446d-9c14-ca2f23ac8da3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 08:08:11 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 08:08:11 user nova-compute[74963]:  {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:11 user nova-compute[74963]: WARNING os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 08:08:11 user nova-compute[74963]: 
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74245de-9e95-43da-9174-c2710cef0372]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0, portal: 172.16.0.220,3260]
Nov 30 08:08:11 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0, portal: 172.16.0.220,3260] successful.
Nov 30 08:08:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0b0c20-be20-44c2-92ec-2c60b8a1d6fc]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[195b0240-0536-43d2-ad8b-8dd161fa5eb7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 (non-flash)
Nov 30 08:08:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 (non-flash)
Nov 30 08:08:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1f0ccc-0736-41e1-a82f-902340de3cbd]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:08:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUmYfJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:08:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26435313530626163', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435313530626163', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:08:12 user nova-compute[74963]: DEBUG nova.objects.instance [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lazy-loading 'flavor' on Instance uuid 12839e0a-b601-49f3-910e-fb41627ba2c7 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:08:12 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:12 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:08:12 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:08:12 user nova-compute[74963]:   <serial>3db01166-674e-435a-b2fe-a62034f133d0</serial>
Nov 30 08:08:12 user nova-compute[74963]: </disk>
Nov 30 08:08:12 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:08:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] No VIF found with MAC fa:16:3e:78:a4:a1, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:08:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-399161e5-1a61-4039-b3c3-d1571c5682d4 tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.050s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "12839e0a-b601-49f3-910e-fb41627ba2c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:14 user nova-compute[74963]: INFO nova.compute.manager [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Terminating instance
Nov 30 08:08:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-b1353e2b-a448-4b52-90b2-a6577c16c01f req-d22090f6-91f9-49ee-9eb3-cdd8c940c4a4 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received event network-vif-unplugged-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b1353e2b-a448-4b52-90b2-a6577c16c01f req-d22090f6-91f9-49ee-9eb3-cdd8c940c4a4 service nova] Acquiring lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b1353e2b-a448-4b52-90b2-a6577c16c01f req-d22090f6-91f9-49ee-9eb3-cdd8c940c4a4 service nova] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b1353e2b-a448-4b52-90b2-a6577c16c01f req-d22090f6-91f9-49ee-9eb3-cdd8c940c4a4 service nova] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-b1353e2b-a448-4b52-90b2-a6577c16c01f req-d22090f6-91f9-49ee-9eb3-cdd8c940c4a4 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] No waiting events found dispatching network-vif-unplugged-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:08:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-b1353e2b-a448-4b52-90b2-a6577c16c01f req-d22090f6-91f9-49ee-9eb3-cdd8c940c4a4 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received event network-vif-unplugged-98ba294c-6057-46c9-8899-c6b901972342 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:08:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Instance destroyed successfully.
Nov 30 08:08:15 user nova-compute[74963]: DEBUG nova.objects.instance [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lazy-loading 'resources' on Instance uuid 12839e0a-b601-49f3-910e-fb41627ba2c7 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1508935788',display_name='tempest-DeleteServersTestJSON-server-1508935788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1508935788',id=3,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='134571570f864b598a5b419156d7847e',ramdisk_id='',reservation_id='r-pccr6kp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1272836046',owner_user_name='tempest-DeleteServersTestJSON-1272836046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:22Z,user_data=None,user_id='275934c9efc348e3a8a116ee8298e88d',uuid=12839e0a-b601-49f3-910e-fb41627ba2c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Converting VIF {"id": "98ba294c-6057-46c9-8899-c6b901972342", "address": "fa:16:3e:78:a4:a1", "network": {"id": "3038bc7c-42b3-4406-a695-4706b8f37288", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829754663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134571570f864b598a5b419156d7847e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ba294c-60", "ovs_interfaceid": "98ba294c-6057-46c9-8899-c6b901972342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=98ba294c-6057-46c9-8899-c6b901972342,network=Network(3038bc7c-42b3-4406-a695-4706b8f37288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ba294c-60') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_vif [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=98ba294c-6057-46c9-8899-c6b901972342,network=Network(3038bc7c-42b3-4406-a695-4706b8f37288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ba294c-60') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98ba294c-60, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e65cfad9-76cf-472e-952a-f0226112c93f) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:15 user nova-compute[74963]: INFO os_vif [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=98ba294c-6057-46c9-8899-c6b901972342,network=Network(3038bc7c-42b3-4406-a695-4706b8f37288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ba294c-60')
Nov 30 08:08:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUmYfJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:15 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3716e1fb-4c69-493d-8506-9487bc38d2f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:08:15 user nova-compute[74963]: No targets found.
Nov 30 08:08:15 user nova-compute[74963]: iSNS:
Nov 30 08:08:15 user nova-compute[74963]: No targets found.
Nov 30 08:08:15 user nova-compute[74963]: STATIC:
Nov 30 08:08:15 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0
Nov 30 08:08:15 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:08:15 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:08:15 user nova-compute[74963]: FIRMWARE:
Nov 30 08:08:15 user nova-compute[74963]: No targets found.
Nov 30 08:08:15 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:08:15 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:08:15 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8433f683-de9d-4cc3-b9ac-f5fbbcde7c62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d448a54-5ba2-418b-b0d9-79c9df990ced]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 (non-flash)
Nov 30 08:08:15 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 (non-flash)
Nov 30 08:08:15 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62444a05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4153b41f-0e8e-4373-883f-f8d2540848eb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d492f67-020a-49e7-9d8a-894e2c3e906d]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff9ae7b-6e6e-4ffc-98e7-246bbfc658b7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aaaba4-ace5-4e6c-b3ca-ff3584a869e7]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e76c35b-ceb1-42d4-a14c-3a39f7de217a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0e9f66-50d0-4b19-8b11-eac613442ddb]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0, portal: 172.16.0.220,3260]
Nov 30 08:08:15 user nova-compute[74963]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0, portal: 172.16.0.220,3260] successful.
Nov 30 08:08:15 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db01166-674e-435a-b2fe-a62034f133d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f194095f-5c73-4a7a-8a2a-40cc9ecdef18]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] <== disconnect_volume: return (300ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:08:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Deleting instance files /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7_del
Nov 30 08:08:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Deletion of /opt/stack/data/nova/instances/12839e0a-b601-49f3-910e-fb41627ba2c7_del complete
Nov 30 08:08:15 user nova-compute[74963]: INFO nova.compute.manager [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 30 08:08:15 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:08:15 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-a0a437c9-24d9-4773-9227-936f799942ba req-79171a6d-a285-414f-a6f7-6e59afa928a0 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received event network-changed-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-a0a437c9-24d9-4773-9227-936f799942ba req-79171a6d-a285-414f-a6f7-6e59afa928a0 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Refreshing instance network info cache due to event network-changed-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0a437c9-24d9-4773-9227-936f799942ba req-79171a6d-a285-414f-a6f7-6e59afa928a0 service nova] Acquiring lock "refresh_cache-ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0a437c9-24d9-4773-9227-936f799942ba req-79171a6d-a285-414f-a6f7-6e59afa928a0 service nova] Acquired lock "refresh_cache-ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG nova.network.neutron [req-a0a437c9-24d9-4773-9227-936f799942ba req-79171a6d-a285-414f-a6f7-6e59afa928a0 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Refreshing network info cache for port a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:16 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Took 1.11 seconds to deallocate network for instance.
Nov 30 08:08:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-2a416040-d12a-42c0-94c2-02c0a910ba17 req-69a692ba-2c14-4fc6-b88c-a9ae2f8eec01 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received event network-vif-plugged-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2a416040-d12a-42c0-94c2-02c0a910ba17 req-69a692ba-2c14-4fc6-b88c-a9ae2f8eec01 service nova] Acquiring lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2a416040-d12a-42c0-94c2-02c0a910ba17 req-69a692ba-2c14-4fc6-b88c-a9ae2f8eec01 service nova] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2a416040-d12a-42c0-94c2-02c0a910ba17 req-69a692ba-2c14-4fc6-b88c-a9ae2f8eec01 service nova] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-2a416040-d12a-42c0-94c2-02c0a910ba17 req-69a692ba-2c14-4fc6-b88c-a9ae2f8eec01 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] No waiting events found dispatching network-vif-plugged-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:08:16 user nova-compute[74963]: WARNING nova.compute.manager [req-2a416040-d12a-42c0-94c2-02c0a910ba17 req-69a692ba-2c14-4fc6-b88c-a9ae2f8eec01 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received unexpected event network-vif-plugged-98ba294c-6057-46c9-8899-c6b901972342 for instance with vm_state active and task_state deleting.
Nov 30 08:08:16 user nova-compute[74963]: DEBUG nova.network.neutron [req-a0a437c9-24d9-4773-9227-936f799942ba req-79171a6d-a285-414f-a6f7-6e59afa928a0 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Updated VIF entry in instance network info cache for port a52e00e9-66d0-4b80-b8f5-09aa9081e6c3. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG nova.network.neutron [req-a0a437c9-24d9-4773-9227-936f799942ba req-79171a6d-a285-414f-a6f7-6e59afa928a0 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Updating instance_info_cache with network_info: [{"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0a437c9-24d9-4773-9227-936f799942ba req-79171a6d-a285-414f-a6f7-6e59afa928a0 service nova] Releasing lock "refresh_cache-ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:17 user nova-compute[74963]: INFO nova.compute.manager [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Took 0.87 seconds to detach 1 volumes for instance.
Nov 30 08:08:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:17 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:08:18 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:08:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:18 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Deleted allocations for instance 12839e0a-b601-49f3-910e-fb41627ba2c7
Nov 30 08:08:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-531f4cd4-f038-410f-83c0-5b44ce60205d tempest-DeleteServersTestJSON-1272836046 tempest-DeleteServersTestJSON-1272836046-project-member] Lock "12839e0a-b601-49f3-910e-fb41627ba2c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.829s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:18 user nova-compute[74963]: DEBUG nova.compute.manager [req-507c6134-41ee-43da-ba98-c2373905a53b req-628bb50c-316f-4368-a52c-ecc9e266e555 service nova] [instance: 12839e0a-b601-49f3-910e-fb41627ba2c7] Received event network-vif-deleted-98ba294c-6057-46c9-8899-c6b901972342 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:19 user nova-compute[74963]: DEBUG nova.objects.instance [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lazy-loading 'flavor' on Instance uuid ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:20 user nova-compute[74963]: INFO nova.compute.manager [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Attaching volume b97a2f73-a467-4a47-be09-dd0f618fb5c1 to /dev/sdc
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.utils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2ed319-5762-4997-ae48-bab43e7a9eb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-256cf22d-7539-49ab-8605-2359c8da4ddd req-84380428-be77-43f4-a4e3-7774659b88cc service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received event network-changed-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-256cf22d-7539-49ab-8605-2359c8da4ddd req-84380428-be77-43f4-a4e3-7774659b88cc service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Refreshing instance network info cache due to event network-changed-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-256cf22d-7539-49ab-8605-2359c8da4ddd req-84380428-be77-43f4-a4e3-7774659b88cc service nova] Acquiring lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-256cf22d-7539-49ab-8605-2359c8da4ddd req-84380428-be77-43f4-a4e3-7774659b88cc service nova] Acquired lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-256cf22d-7539-49ab-8605-2359c8da4ddd req-84380428-be77-43f4-a4e3-7774659b88cc service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Refreshing network info cache for port c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae1b5aa-41dd-4fa0-8f97-1aef62e88bad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[191364ff-742c-429d-bc8e-ab8ec4214cb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae98c62-b2a7-4da4-a49d-3fe4fedcf4bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:20 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b736a2cb-c1be-44b4-8127-803401531813]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.utils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Updating existing volume attachment record: 4ad2dd62-e00b-40d2-bc7c-851f5e723299 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG nova.objects.instance [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lazy-loading 'flavor' on Instance uuid 98e1c4f0-b628-435a-bf98-f814fa927873 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-256cf22d-7539-49ab-8605-2359c8da4ddd req-84380428-be77-43f4-a4e3-7774659b88cc service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Updated VIF entry in instance network info cache for port c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-256cf22d-7539-49ab-8605-2359c8da4ddd req-84380428-be77-43f4-a4e3-7774659b88cc service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Updating instance_info_cache with network_info: [{"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-256cf22d-7539-49ab-8605-2359c8da4ddd req-84380428-be77-43f4-a4e3-7774659b88cc service nova] Releasing lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:20 user nova-compute[74963]: INFO nova.compute.manager [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Attaching volume 0a3b04f8-6848-4379-a798-0d0dc10a0232 to /dev/vdb
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.utils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d5de2-bcb8-4a7f-98f7-fe7d1464a786]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e616011-08eb-45f1-b954-709844af09c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d7fa14-9c63-4d66-98cd-8563fe9e0d66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e1f9b-f02c-4940-ba8b-8e8218699993]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:20 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:08:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07a06ea-b5ef-4144-8d54-6d4b97ca4529]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG os_brick.utils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:20 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Updating existing volume attachment record: 90ac2239-8b9b-4af5-b64f-3d1bc8ad3e5a {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:08:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-5a35b6b3-6990-4c62-8bf5-8bed43206262 req-c8f7acb6-5804-4695-b32b-6c4009b3f87c service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received event network-changed-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-5a35b6b3-6990-4c62-8bf5-8bed43206262 req-c8f7acb6-5804-4695-b32b-6c4009b3f87c service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Refreshing instance network info cache due to event network-changed-c797d1f2-cde0-44bf-8552-2f00b88d549a. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:08:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5a35b6b3-6990-4c62-8bf5-8bed43206262 req-c8f7acb6-5804-4695-b32b-6c4009b3f87c service nova] Acquiring lock "refresh_cache-9579e650-53bf-4772-888e-aa95a4108f75" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5a35b6b3-6990-4c62-8bf5-8bed43206262 req-c8f7acb6-5804-4695-b32b-6c4009b3f87c service nova] Acquired lock "refresh_cache-9579e650-53bf-4772-888e-aa95a4108f75" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:21 user nova-compute[74963]: DEBUG nova.network.neutron [req-5a35b6b3-6990-4c62-8bf5-8bed43206262 req-c8f7acb6-5804-4695-b32b-6c4009b3f87c service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Refreshing network info cache for port c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "9579e650-53bf-4772-888e-aa95a4108f75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lazy-loading 'flavor' on Instance uuid 9579e650-53bf-4772-888e-aa95a4108f75 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-5a35b6b3-6990-4c62-8bf5-8bed43206262 req-c8f7acb6-5804-4695-b32b-6c4009b3f87c service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Updated VIF entry in instance network info cache for port c797d1f2-cde0-44bf-8552-2f00b88d549a. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-5a35b6b3-6990-4c62-8bf5-8bed43206262 req-c8f7acb6-5804-4695-b32b-6c4009b3f87c service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Updating instance_info_cache with network_info: [{"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5a35b6b3-6990-4c62-8bf5-8bed43206262 req-c8f7acb6-5804-4695-b32b-6c4009b3f87c service nova] Releasing lock "refresh_cache-9579e650-53bf-4772-888e-aa95a4108f75" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "9579e650-53bf-4772-888e-aa95a4108f75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.175s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "9579e650-53bf-4772-888e-aa95a4108f75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:22 user nova-compute[74963]: INFO nova.compute.manager [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Attaching volume c472ea78-420f-43b7-8674-0f2e4cf76abb to /dev/vdb
Nov 30 08:08:22 user nova-compute[74963]: DEBUG os_brick.utils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b148b-6e08-46f1-b9e9-24e5906d0850]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[84242c61-5afc-4459-a8ca-b1767a03e452]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b47c70-f25d-4628-8161-03d0c4f13ea4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[955a84fa-b8b6-4ae8-93b2-4e082970dc54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:22 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:08:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de012f1d-1bd0-47b1-a591-beee1bc5d67a]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG os_brick.utils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:22 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Updating existing volume attachment record: 362a24d0-90da-47df-8328-4eb4030d1729 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "interface-6fec797d-1752-464f-8e89-3f1b21cda724-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "interface-6fec797d-1752-464f-8e89-3f1b21cda724-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lazy-loading 'flavor' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lazy-loading 'pci_requests' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG nova.objects.base [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Object Instance<6fec797d-1752-464f-8e89-3f1b21cda724> lazy-loaded attributes: flavor,pci_requests {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG nova.policy [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '644095bd2e894f0db86ed3a7d1a06c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069409ef36774791b13e4a3eec8d6648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-25209120-6e7b-4bd6-8791-a5511ff59c4a req-7d065996-5c79-4d4c-a565-ede7715cfcd6 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-changed-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-25209120-6e7b-4bd6-8791-a5511ff59c4a req-7d065996-5c79-4d4c-a565-ede7715cfcd6 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Refreshing instance network info cache due to event network-changed-662f4120-2ba1-466d-81b6-212565a16a9d. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-25209120-6e7b-4bd6-8791-a5511ff59c4a req-7d065996-5c79-4d4c-a565-ede7715cfcd6 service nova] Acquiring lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-25209120-6e7b-4bd6-8791-a5511ff59c4a req-7d065996-5c79-4d4c-a565-ede7715cfcd6 service nova] Acquired lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:23 user nova-compute[74963]: DEBUG nova.network.neutron [req-25209120-6e7b-4bd6-8791-a5511ff59c4a req-7d065996-5c79-4d4c-a565-ede7715cfcd6 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Refreshing network info cache for port 662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:08:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-25209120-6e7b-4bd6-8791-a5511ff59c4a req-7d065996-5c79-4d4c-a565-ede7715cfcd6 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updated VIF entry in instance network info cache for port 662f4120-2ba1-466d-81b6-212565a16a9d. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:08:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-25209120-6e7b-4bd6-8791-a5511ff59c4a req-7d065996-5c79-4d4c-a565-ede7715cfcd6 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updating instance_info_cache with network_info: [{"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-25209120-6e7b-4bd6-8791-a5511ff59c4a req-7d065996-5c79-4d4c-a565-ede7715cfcd6 service nova] Releasing lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:24 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Successfully created port: 548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Successfully updated port: 548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquired lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-a28c06e2-ea9e-4e2b-9ee8-90d9295280ab req-2acc1e78-f0ce-4b0c-96c9-8db41693f454 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-changed-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-a28c06e2-ea9e-4e2b-9ee8-90d9295280ab req-2acc1e78-f0ce-4b0c-96c9-8db41693f454 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Refreshing instance network info cache due to event network-changed-548f0039-1236-4fb1-bcbd-57351dad1f9a. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a28c06e2-ea9e-4e2b-9ee8-90d9295280ab req-2acc1e78-f0ce-4b0c-96c9-8db41693f454 service nova] Acquiring lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updating instance_info_cache with network_info: [{"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Releasing lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a28c06e2-ea9e-4e2b-9ee8-90d9295280ab req-2acc1e78-f0ce-4b0c-96c9-8db41693f454 service nova] Acquired lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.network.neutron [req-a28c06e2-ea9e-4e2b-9ee8-90d9295280ab req-2acc1e78-f0ce-4b0c-96c9-8db41693f454 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Refreshing network info cache for port 548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560530600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560530600',id=8,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIIMB50S1UrUdAIYurXG++T+DeKVYav11Y2BaKQ3ngEyQM/V5KCBuxUZ9zN/R/zlOKWamLw2XB6+Vkj/xUqSM+aCM6/ySzgbLvOn3nCdOOw3/wxulg0yoXKpuiKCLYag==',key_name='tempest-keypair-1537203754',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='069409ef36774791b13e4a3eec8d6648',ramdisk_id='',reservation_id='r-zjozxt7j',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-834159471',owner_user_name='tempest-TaggedAttachmentsTest-834159471-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='644095bd2e894f0db86ed3a7d1a06c7a',uuid=6fec797d-1752-464f-8e89-3f1b21cda724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converting VIF {"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG os_vif [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c5fd23b-985f-542b-9c56-1db2ce4983da', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap548f0039-12, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap548f0039-12, col_values=(('qos', UUID('fa7eeaa4-e76e-4249-b0f6-6657e6ea3335')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap548f0039-12, col_values=(('external_ids', {'iface-id': '548f0039-1236-4fb1-bcbd-57351dad1f9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:8b:41', 'vm-uuid': '6fec797d-1752-464f-8e89-3f1b21cda724'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:25 user nova-compute[74963]: INFO os_vif [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12')
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560530600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560530600',id=8,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIIMB50S1UrUdAIYurXG++T+DeKVYav11Y2BaKQ3ngEyQM/V5KCBuxUZ9zN/R/zlOKWamLw2XB6+Vkj/xUqSM+aCM6/ySzgbLvOn3nCdOOw3/wxulg0yoXKpuiKCLYag==',key_name='tempest-keypair-1537203754',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='069409ef36774791b13e4a3eec8d6648',ramdisk_id='',reservation_id='r-zjozxt7j',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-834159471',owner_user_name='tempest-TaggedAttachmentsTest-834159471-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='644095bd2e894f0db86ed3a7d1a06c7a',uuid=6fec797d-1752-464f-8e89-3f1b21cda724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converting VIF {"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] attach device xml: <interface type="ethernet">
Nov 30 08:08:25 user nova-compute[74963]:   <mac address="fa:16:3e:a9:8b:41"/>
Nov 30 08:08:25 user nova-compute[74963]:   <model type="virtio"/>
Nov 30 08:08:25 user nova-compute[74963]:   <mtu size="1442"/>
Nov 30 08:08:25 user nova-compute[74963]:   <target dev="tap548f0039-12"/>
Nov 30 08:08:25 user nova-compute[74963]: </interface>
Nov 30 08:08:25 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-a28c06e2-ea9e-4e2b-9ee8-90d9295280ab req-2acc1e78-f0ce-4b0c-96c9-8db41693f454 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updated VIF entry in instance network info cache for port 548f0039-1236-4fb1-bcbd-57351dad1f9a. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-a28c06e2-ea9e-4e2b-9ee8-90d9295280ab req-2acc1e78-f0ce-4b0c-96c9-8db41693f454 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updating instance_info_cache with network_info: [{"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a28c06e2-ea9e-4e2b-9ee8-90d9295280ab req-2acc1e78-f0ce-4b0c-96c9-8db41693f454 service nova] Releasing lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-b9d2d063-5f20-407c-b13a-fd163963d05d req-43006090-d186-469e-9550-58696d3b7943 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-plugged-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b9d2d063-5f20-407c-b13a-fd163963d05d req-43006090-d186-469e-9550-58696d3b7943 service nova] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b9d2d063-5f20-407c-b13a-fd163963d05d req-43006090-d186-469e-9550-58696d3b7943 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b9d2d063-5f20-407c-b13a-fd163963d05d req-43006090-d186-469e-9550-58696d3b7943 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-b9d2d063-5f20-407c-b13a-fd163963d05d req-43006090-d186-469e-9550-58696d3b7943 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] No waiting events found dispatching network-vif-plugged-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:08:26 user nova-compute[74963]: WARNING nova.compute.manager [req-b9d2d063-5f20-407c-b13a-fd163963d05d req-43006090-d186-469e-9550-58696d3b7943 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received unexpected event network-vif-plugged-548f0039-1236-4fb1-bcbd-57351dad1f9a for instance with vm_state active and task_state None.
Nov 30 08:08:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] No BDM found with device name hda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] No VIF found with MAC fa:16:3e:15:71:ec, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:08:26 user nova-compute[74963]:   <nova:package version="0.0.0"/>
Nov 30 08:08:26 user nova-compute[74963]:   <nova:name>tempest-device-tagging-server-1560530600</nova:name>
Nov 30 08:08:26 user nova-compute[74963]:   <nova:creationTime>2023-11-30 08:08:26</nova:creationTime>
Nov 30 08:08:26 user nova-compute[74963]:   <nova:flavor name="m1.tiny">
Nov 30 08:08:26 user nova-compute[74963]:     <nova:memory>512</nova:memory>
Nov 30 08:08:26 user nova-compute[74963]:     <nova:disk>1</nova:disk>
Nov 30 08:08:26 user nova-compute[74963]:     <nova:swap>0</nova:swap>
Nov 30 08:08:26 user nova-compute[74963]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:08:26 user nova-compute[74963]:     <nova:vcpus>1</nova:vcpus>
Nov 30 08:08:26 user nova-compute[74963]:   </nova:flavor>
Nov 30 08:08:26 user nova-compute[74963]:   <nova:owner>
Nov 30 08:08:26 user nova-compute[74963]:     <nova:user uuid="644095bd2e894f0db86ed3a7d1a06c7a">tempest-TaggedAttachmentsTest-834159471-project-member</nova:user>
Nov 30 08:08:26 user nova-compute[74963]:     <nova:project uuid="069409ef36774791b13e4a3eec8d6648">tempest-TaggedAttachmentsTest-834159471</nova:project>
Nov 30 08:08:26 user nova-compute[74963]:   </nova:owner>
Nov 30 08:08:26 user nova-compute[74963]:   <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:08:26 user nova-compute[74963]:   <nova:ports>
Nov 30 08:08:26 user nova-compute[74963]:     <nova:port uuid="662f4120-2ba1-466d-81b6-212565a16a9d">
Nov 30 08:08:26 user nova-compute[74963]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:08:26 user nova-compute[74963]:     </nova:port>
Nov 30 08:08:26 user nova-compute[74963]:     <nova:port uuid="548f0039-1236-4fb1-bcbd-57351dad1f9a">
Nov 30 08:08:26 user nova-compute[74963]:       <nova:ip type="fixed" address="10.10.10.126" ipVersion="4"/>
Nov 30 08:08:26 user nova-compute[74963]:     </nova:port>
Nov 30 08:08:26 user nova-compute[74963]:   </nova:ports>
Nov 30 08:08:26 user nova-compute[74963]: </nova:instance>
Nov 30 08:08:26 user nova-compute[74963]:  {{(pid=74963) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ef001656-31ee-4fcb-a224-e72d3b197204 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "interface-6fec797d-1752-464f-8e89-3f1b21cda724-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.101s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-71ab6a47-7053-4913-9e43-7c80d2d1f25f req-f6c10be0-d505-4d40-9c5a-1deab5e67ec9 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-plugged-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-71ab6a47-7053-4913-9e43-7c80d2d1f25f req-f6c10be0-d505-4d40-9c5a-1deab5e67ec9 service nova] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-71ab6a47-7053-4913-9e43-7c80d2d1f25f req-f6c10be0-d505-4d40-9c5a-1deab5e67ec9 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-71ab6a47-7053-4913-9e43-7c80d2d1f25f req-f6c10be0-d505-4d40-9c5a-1deab5e67ec9 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-71ab6a47-7053-4913-9e43-7c80d2d1f25f req-f6c10be0-d505-4d40-9c5a-1deab5e67ec9 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] No waiting events found dispatching network-vif-plugged-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:08:28 user nova-compute[74963]: WARNING nova.compute.manager [req-71ab6a47-7053-4913-9e43-7c80d2d1f25f req-f6c10be0-d505-4d40-9c5a-1deab5e67ec9 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received unexpected event network-vif-plugged-548f0039-1236-4fb1-bcbd-57351dad1f9a for instance with vm_state active and task_state None.
Nov 30 08:08:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylaBQLbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:28 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:28 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:28 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[426b12e1-a218-4e6e-994c-f9fa982b5a37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:08:28 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14321e6-31ec-46e0-928f-7671cbb66f8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1] added
Nov 30 08:08:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[859d91fd-2d78-448d-b9c8-739857165c01]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0f07cf-8cf3-432b-bb87-f29a68fe082d]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylaBQLbm {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylaBQLbm" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e9e6f6-76a9-4ded-9ea8-0e3a42777563]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ylaBQLbm'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5072d6da-4f3e-41d0-9f97-fafd596dc79a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af7a874-6c0f-4535-a475-96a7e7f5815b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 08:08:28 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 08:08:28 user nova-compute[74963]:  {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:28 user nova-compute[74963]: WARNING os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 08:08:28 user nova-compute[74963]: 
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d11e2f-1465-4171-98f0-76c906347538]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1, portal: 172.16.0.220,3260]
Nov 30 08:08:28 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1, portal: 172.16.0.220,3260] successful.
Nov 30 08:08:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[251acc81-0616-4409-a251-9324f64aa069]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac26e8e-9642-46e1-b8c7-9e7ec0d6694a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f323f-654b-482a-b630-e55839ead758]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylaBQLbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:28 user nova-compute[74963]: DEBUG nova.objects.instance [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lazy-loading 'flavor' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:29 user nova-compute[74963]: INFO nova.compute.manager [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Attaching volume 0b25be61-18b1-48b3-a03b-889f42dd6062 to /dev/vdb
Nov 30 08:08:29 user nova-compute[74963]: DEBUG os_brick.utils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa68827-9cb8-4a9c-b3c3-ea46b7a59bfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1774a3f2-8cd0-4947-9238-b898c982abbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[70464681-6444-451a-b300-c2e43c6346bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f6fcbb-19e8-4037-a49a-b8fedd4b1b44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:29 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:08:29 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9c0d54-a037-40bb-9f27-c72ce071f32b]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG os_brick.utils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updating existing volume attachment record: 8b969074-6189-41a0-bd22-7d35e1e20152 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23961353430643232', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961353430643232', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:08:29 user nova-compute[74963]: DEBUG nova.objects.instance [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lazy-loading 'flavor' on Instance uuid ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:08:30 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:30 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:08:30 user nova-compute[74963]:   <target dev="sdc" bus="scsi"/>
Nov 30 08:08:30 user nova-compute[74963]:   <serial>b97a2f73-a467-4a47-be09-dd0f618fb5c1</serial>
Nov 30 08:08:30 user nova-compute[74963]:   <address type="drive" controller="0" unit="2"/>
Nov 30 08:08:30 user nova-compute[74963]: </disk>
Nov 30 08:08:30 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:08:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] No BDM found with device name sda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] No VIF found with MAC fa:16:3e:a3:31:18, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:08:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLMobHzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:37 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:37 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:37 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:08:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[19419fe3-ce8d-43a7-a583-1e5a7c59649d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:08:37 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[494734c6-a56b-48e0-9f59-6e9aeaaf60ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062] added
Nov 30 08:08:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.063s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[21187565-dddc-4dfa-980f-d030bff11bfe]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f5a6e5-2266-4784-96fb-272b68064d40]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NLMobHzs {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NLMobHzs" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[560081d0-dcc7-46b4-9317-d0df8bc23f34]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NLMobHzs'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7231d687-8b6c-4a8d-aa39-3c6604da4813]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b210045-616a-4f9c-85f7-213ae1b04f84]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:38 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:38 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[394acffb-6be0-4962-bd22-19902bb78a25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062, portal: 172.16.0.220,3260]
Nov 30 08:08:38 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062, portal: 172.16.0.220,3260] successful.
Nov 30 08:08:38 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4b1f3-f296-4901-aeb0-1392b036b5c5]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9419e2f-10fa-4283-ad36-ea605ea6f60a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:38 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:38 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:38 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:38 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[082449f6-72f5-45d7-8a01-821970d5aa9b]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLMobHzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-88e362f8-cfc4-401a-a3dd-19e3195aa453 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.304s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23362336635643862', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362336635643862', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.objects.instance [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lazy-loading 'flavor' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:08:39 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:39 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:08:39 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:08:39 user nova-compute[74963]:   <serial>0b25be61-18b1-48b3-a03b-889f42dd6062</serial>
Nov 30 08:08:39 user nova-compute[74963]: </disk>
Nov 30 08:08:39 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:39 user nova-compute[74963]: INFO nova.compute.manager [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Detaching volume b97a2f73-a467-4a47-be09-dd0f618fb5c1
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] No BDM found with device name hda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] No VIF found with MAC fa:16:3e:15:71:ec, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:08:39 user nova-compute[74963]: INFO nova.virt.block_device [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Attempting to driver detach volume b97a2f73-a467-4a47-be09-dd0f618fb5c1 from mountpoint /dev/sdc
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Attempting to detach device sdc from instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:08:39 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:39 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:08:39 user nova-compute[74963]:   <target dev="sdc" bus="scsi"/>
Nov 30 08:08:39 user nova-compute[74963]:   <serial>b97a2f73-a467-4a47-be09-dd0f618fb5c1</serial>
Nov 30 08:08:39 user nova-compute[74963]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 08:08:39 user nova-compute[74963]: </disk>
Nov 30 08:08:39 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:08:39 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Successfully detached device sdc from instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 from the persistent domain config.
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:08:39 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:39 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:08:39 user nova-compute[74963]:   <target dev="sdc" bus="scsi"/>
Nov 30 08:08:39 user nova-compute[74963]:   <serial>b97a2f73-a467-4a47-be09-dd0f618fb5c1</serial>
Nov 30 08:08:39 user nova-compute[74963]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 08:08:39 user nova-compute[74963]: </disk>
Nov 30 08:08:39 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:08:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9464d7be-e424-49f4-9d20-1f5571338ab7 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.757s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:08:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:41 user nova-compute[74963]: INFO nova.compute.manager [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Detaching volume 0b25be61-18b1-48b3-a03b-889f42dd6062
Nov 30 08:08:41 user nova-compute[74963]: INFO nova.virt.block_device [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Attempting to driver detach volume 0b25be61-18b1-48b3-a03b-889f42dd6062 from mountpoint /dev/vdb
Nov 30 08:08:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Attempting to detach device vdb from instance 6fec797d-1752-464f-8e89-3f1b21cda724 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:08:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:08:41 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:41 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:08:41 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:08:41 user nova-compute[74963]:   <serial>0b25be61-18b1-48b3-a03b-889f42dd6062</serial>
Nov 30 08:08:41 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 08:08:41 user nova-compute[74963]: </disk>
Nov 30 08:08:41 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:08:41 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Successfully detached device vdb from instance 6fec797d-1752-464f-8e89-3f1b21cda724 from the persistent domain config.
Nov 30 08:08:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fec797d-1752-464f-8e89-3f1b21cda724 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:08:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:08:41 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:41 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:08:41 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:08:41 user nova-compute[74963]:   <serial>0b25be61-18b1-48b3-a03b-889f42dd6062</serial>
Nov 30 08:08:41 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 08:08:41 user nova-compute[74963]: </disk>
Nov 30 08:08:41 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:08:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUsSNWnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:42 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:42 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:42 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a43ed-e374-44cf-b187-52fde8118ac7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:08:42 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c58b65e-83e7-4b48-82ac-ef6a7f5e680e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb] added
Nov 30 08:08:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf113d5-92d4-43ca-a143-57eb8627b811]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0bdfd8-e573-4576-9371-fddf3c1135d3]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUsSNWnp {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUsSNWnp" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd6c71b-03d1-4601-8e41-95cdb6415d25]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUsSNWnp'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f433e6-5581-4d32-94d6-5eadb6ddddf5]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDczNgwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:42 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436baf6-55b2-4e38-9a71-54c99f5442cc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:42 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:42 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6e6e0b-5b59-46e7-a0d6-cd14d03a2460]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb, portal: 172.16.0.220,3260]
Nov 30 08:08:42 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb, portal: 172.16.0.220,3260] successful.
Nov 30 08:08:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b047db-41f9-4eed-a1f4-c06fdb5b82bf]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[032f41c6-3bb1-4c6a-9d73-77174e3547c9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:42 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:42 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:42 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:42 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ce1236-699d-4897-8ba2-74b4dad52bf2]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:08:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUsSNWnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23461343834353365', 'path': '/dev/sdd'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461343834353365', 'path': '/dev/sdd'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.157s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:43 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:43 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lazy-loading 'flavor' on Instance uuid 9579e650-53bf-4772-888e-aa95a4108f75 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ea9a49-4c8e-4326-94b5-3c68a32dcb6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:08:43 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[756efdb4-0a0c-458a-a863-787975e45706]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232] added
Nov 30 08:08:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] attach device xml: <disk type="block" device="disk">
Nov 30 08:08:43 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:43 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:08:43 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:08:43 user nova-compute[74963]:   <serial>c472ea78-420f-43b7-8674-0f2e4cf76abb</serial>
Nov 30 08:08:43 user nova-compute[74963]: </disk>
Nov 30 08:08:43 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[df46aff9-af38-4726-8b31-f63dfb7e5531]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[783ae34a-a17d-4028-96f6-68963813e1f6]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDczNgwv {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDczNgwv" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de62e28-b399-4261-9aca-4ffafdf01080]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WDczNgwv'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0473691d-bd9a-48a0-8133-e5679ac1b686]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6077024b-6631-40e4-897a-a1e4587ff720]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a727c4c-91e1-425c-a189-b0e2382d8a0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260]
Nov 30 08:08:43 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260] successful.
Nov 30 08:08:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c3a5c-c198-4b9a-88b9-fcdd2288d166]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83a39f1-0897-4de5-af02-59a24b0699cc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:43 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:08:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af5091b-8ba7-45a5-a4f5-2f8351bb8c8b]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDczNgwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] No VIF found with MAC fa:16:3e:d5:c5:5e, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:08:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c5a7ba8-8e93-4bb9-ac33-e09d20a2aaae tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "9579e650-53bf-4772-888e-aa95a4108f75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.585s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] <== connect_volume: return (2484ms) {'type': 'block', 'scsi_wwn': '26231643239656366', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231643239656366', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:08:44 user nova-compute[74963]: DEBUG nova.objects.instance [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lazy-loading 'flavor' on Instance uuid 98e1c4f0-b628-435a-bf98-f814fa927873 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:08:44 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:44 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:08:44 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:08:44 user nova-compute[74963]:   <serial>0a3b04f8-6848-4379-a798-0d0dc10a0232</serial>
Nov 30 08:08:44 user nova-compute[74963]: </disk>
Nov 30 08:08:44 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-4e73d150-a446-4b4f-b555-fd7185346e03 tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] volume_snapshot_create: create_info: {'snapshot_id': '15e5fe13-938a-4f1b-b53e-58016499f298', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74963) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-4e73d150-a446-4b4f-b555-fd7185346e03 tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] snap xml: <domainsnapshot>
Nov 30 08:08:45 user nova-compute[74963]:   <disks>
Nov 30 08:08:45 user nova-compute[74963]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 30 08:08:45 user nova-compute[74963]:       <source file="/dev/new_file"/>
Nov 30 08:08:45 user nova-compute[74963]:     </disk>
Nov 30 08:08:45 user nova-compute[74963]:     <disk name="vda" snapshot="no"/>
Nov 30 08:08:45 user nova-compute[74963]:   </disks>
Nov 30 08:08:45 user nova-compute[74963]: </domainsnapshot>
Nov 30 08:08:45 user nova-compute[74963]:  {{(pid=74963) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.objects.instance [None req-4e73d150-a446-4b4f-b555-fd7185346e03 tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] Lazy-loading 'system_metadata' on Instance uuid 9579e650-53bf-4772-888e-aa95a4108f75 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-4e73d150-a446-4b4f-b555-fd7185346e03 tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [None req-4e73d150-a446-4b4f-b555-fd7185346e03 tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     rv = execute(f, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     six.reraise(c, e, tb)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     raise value
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     rv = meth(*args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75] 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [None req-4e73d150-a446-4b4f-b555-fd7185346e03 tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     self._volume_snapshot_create(context, instance, guest,
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     rv = execute(f, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     six.reraise(c, e, tb)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     raise value
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     rv = meth(*args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75] 
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0b7b2f7-748a-437b-8bd3-83285266128a tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] volume_snapshot_delete: delete_info: {'volume_id': 'c472ea78-420f-43b7-8674-0f2e4cf76abb'} {{(pid=74963) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [None req-f0b7b2f7-748a-437b-8bd3-83285266128a tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75]     if delete_info['type'] != 'qcow2':
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75] KeyError: 'type'
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [instance: 9579e650-53bf-4772-888e-aa95a4108f75] 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [None req-4e73d150-a446-4b4f-b555-fd7185346e03 tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 15e5fe13-938a-4f1b-b53e-58016499f298 could not be found.
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     raise value
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 15e5fe13-938a-4f1b-b53e-58016499f298 could not be found. (HTTP 404) (Request-ID: req-fdd6e830-3dee-4d53-ac4b-58886b95afb9)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 15e5fe13-938a-4f1b-b53e-58016499f298 could not be found.
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server [None req-4e73d150-a446-4b4f-b555-fd7185346e03 tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     raise value
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver [None req-f0b7b2f7-748a-437b-8bd3-83285266128a tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-57f4a8c9-2768-4582-b538-5b1551e2074a)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 08:08:45 user nova-compute[74963]: ERROR nova.virt.libvirt.driver 
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server [None req-f0b7b2f7-748a-437b-8bd3-83285266128a tempest-VolumesAssistedSnapshotsTest-731324547 tempest-VolumesAssistedSnapshotsTest-731324547-project] Exception during message handling: KeyError: 'type'
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 30 08:08:45 user nova-compute[74963]: ERROR oslo_messaging.rpc.server 
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] No VIF found with MAC fa:16:3e:a5:72:4e, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "9579e650-53bf-4772-888e-aa95a4108f75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:45 user nova-compute[74963]: INFO nova.compute.manager [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Detaching volume c472ea78-420f-43b7-8674-0f2e4cf76abb
Nov 30 08:08:45 user nova-compute[74963]: INFO nova.virt.block_device [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Attempting to driver detach volume c472ea78-420f-43b7-8674-0f2e4cf76abb from mountpoint /dev/vdb
Nov 30 08:08:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9ad18936-1ea6-44e8-8b42-605e38c5c419 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.012s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Attempting to detach device vdb from instance 9579e650-53bf-4772-888e-aa95a4108f75 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 08:08:45 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:45 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:08:45 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:08:45 user nova-compute[74963]:   <serial>c472ea78-420f-43b7-8674-0f2e4cf76abb</serial>
Nov 30 08:08:45 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:08:45 user nova-compute[74963]: </disk>
Nov 30 08:08:45 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:08:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Successfully detached device vdb from instance 9579e650-53bf-4772-888e-aa95a4108f75 from the persistent domain config.
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9579e650-53bf-4772-888e-aa95a4108f75 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 08:08:45 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:08:45 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:08:45 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:08:45 user nova-compute[74963]:   <serial>c472ea78-420f-43b7-8674-0f2e4cf76abb</serial>
Nov 30 08:08:45 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:08:45 user nova-compute[74963]: </disk>
Nov 30 08:08:45 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:08:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9579e650-53bf-4772-888e-aa95a4108f75 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG os_brick.utils [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2308f9-7018-43bc-ad79-4e5370c34c90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8be6ce-9850-4cf6-8455-fea63f59eb8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[292b1990-05ae-41bb-b980-694b62b004f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c603e-b70d-4433-9b52-b16d2d31a30b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:08:47 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:08:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df42ce4-82b3-4e24-9c01-6d0c7b6d5f5a]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:08:47 user nova-compute[74963]: DEBUG os_brick.utils [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:47 user nova-compute[74963]: INFO nova.compute.manager [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Swapping volume 0a3b04f8-6848-4379-a798-0d0dc10a0232 for ad1369df-f7ce-4c71-a775-e24b45c31650
Nov 30 08:08:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkrRAnxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98e1c4f0-b628-435a-bf98-f814fa927873', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad1369df-f7ce-4c71-a775-e24b45c31650', 'serial': 'ad1369df-f7ce-4c71-a775-e24b45c31650'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDczNgwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '98e1c4f0-b628-435a-bf98-f814fa927873', 'attached_at': '', 'detached_at': '', 'volume_id': '0a3b04f8-6848-4379-a798-0d0dc10a0232', 'serial'} {{(pid=74963) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkrRAnxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:08:56 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:56 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:08:56 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27c07bd-73e9-4550-8e47-ba8101dcb066]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:08:56 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4569b826-71b5-4687-ae20-d091e8e5653a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650] added
Nov 30 08:08:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.046s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c88666-703e-4c17-bd5e-c4f4b7baf018]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce9193-2cbc-41d1-9a35-fc501ed804dd]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkrRAnxj {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkrRAnxj" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70ed148-fc32-4da5-af43-a1754edf4220]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SkrRAnxj'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6454ab0b-c548-410c-bf46-5b4bcc8d88ca]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e00e0a-2d25-4560-8903-ca7463df7a4e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[265a892b-f123-4cbe-a425-62eb4ede32ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650, portal: 172.16.0.220,3260]
Nov 30 08:08:56 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650, portal: 172.16.0.220,3260] successful.
Nov 30 08:08:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[52767072-b0a7-404b-94cf-42d510b89175]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a753946-32b3-4042-88ac-aec5c6c411d6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:08:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[52360130-8ce4-4ec1-94ef-b659446684cc]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkrRAnxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Updating instance_info_cache with network_info: [{"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:08:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23233366232356237', 'path': '/dev/sdf'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233366232356237', 'path': '/dev/sdf'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lazy-loading 'flavor' on Instance uuid 98e1c4f0-b628-435a-bf98-f814fa927873 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 167772160 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 296747008 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 456130560 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:08:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 575668224 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 is timed out.
Nov 30 08:09:00 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Successfully detached device sdc from instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 from the live domain config.
Nov 30 08:09:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylaBQLbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:00 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3037534c-6406-465a-baeb-4e6ea3a1fe8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:09:00 user nova-compute[74963]: No targets found.
Nov 30 08:09:00 user nova-compute[74963]: iSNS:
Nov 30 08:09:00 user nova-compute[74963]: No targets found.
Nov 30 08:09:00 user nova-compute[74963]: STATIC:
Nov 30 08:09:00 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb
Nov 30 08:09:00 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:00 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:00 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232
Nov 30 08:09:00 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:00 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:00 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062
Nov 30 08:09:00 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:00 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:00 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650
Nov 30 08:09:00 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:00 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:00 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1
Nov 30 08:09:00 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:00 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:00 user nova-compute[74963]: FIRMWARE:
Nov 30 08:09:00 user nova-compute[74963]: No targets found.
Nov 30 08:09:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:09:00 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:09:00 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74e53a7-90ca-42a4-b4fc-0811b791cc5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fe3578-eb9a-49bb-b99b-b179fdbf08a9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:09:00 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:09:00 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:09:00 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:00 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 (non-flash)
Nov 30 08:09:00 user nova-compute[74963]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:09:00 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:09:00 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:00 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244348b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa59ef7f-54cb-482b-8118-373585c90077]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b269a8f4-7fa7-4423-9cc4-2c4e6907fc5e]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[72954fa9-e5f3-453a-a387-56f3155d35d7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa982af1-6339-4e60-8300-8a6f59f7d3a5]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[018bfd4b-5695-4045-bcdb-8d123afcc2b9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 724566016 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3583d62-7ab4-4abb-ad23-ffaf17ab17c2]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1, portal: 172.16.0.220,3260]
Nov 30 08:09:00 user nova-compute[74963]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1, portal: 172.16.0.220,3260] successful.
Nov 30 08:09:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b97a2f73-a467-4a47-be09-dd0f618fb5c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab67da70-a2d1-4ec8-85d4-2b0c6f124ef1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] <== disconnect_volume: return (461ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 870318080 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 1018167296 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:01 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:09:01 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7331MB free_disk=25.44664764404297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 3551893b-4a59-4e6a-a961-8ea6d671632e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 25afcf51-de30-4a53-bb6b-3e7037f5e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 98e1c4f0-b628-435a-bf98-f814fa927873 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9579e650-53bf-4772-888e-aa95a4108f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 6fec797d-1752-464f-8e89-3f1b21cda724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 67d99f85-78de-4702-aa55-758173230187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 16fe9479-fdd8-493f-92f9-a59b84af0342 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:09:01 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6fec797d-1752-464f-8e89-3f1b21cda724 is timed out.
Nov 30 08:09:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Successfully detached device vdb from instance 6fec797d-1752-464f-8e89-3f1b21cda724 from the live domain config.
Nov 30 08:09:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLMobHzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:02 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afaa56d-4095-44af-a3a5-153ebcfd557b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:09:02 user nova-compute[74963]: No targets found.
Nov 30 08:09:02 user nova-compute[74963]: iSNS:
Nov 30 08:09:02 user nova-compute[74963]: No targets found.
Nov 30 08:09:02 user nova-compute[74963]: STATIC:
Nov 30 08:09:02 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb
Nov 30 08:09:02 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:02 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:02 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232
Nov 30 08:09:02 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:02 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:02 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062
Nov 30 08:09:02 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:02 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:02 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650
Nov 30 08:09:02 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:02 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:02 user nova-compute[74963]: FIRMWARE:
Nov 30 08:09:02 user nova-compute[74963]: No targets found.
Nov 30 08:09:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:09:02 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:09:02 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.objects.instance [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lazy-loading 'flavor' on Instance uuid ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b81c406-7354-4112-929c-dcc5abc3d139]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d37e5-b5a9-4142-abfc-d1934d10a1fa]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624438b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062'): ({'sdc'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Removing single pathed devices sdc {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-498f337d-4750-4512-aebb-9bd2cff17408 tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.306s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c15f4c4-89e7-442c-a7c1-78f6d5717bb1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a1638-6894-4f61-a6de-50de8126e939]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Flushing IO for device /dev/sdc {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5f6fe2-6b41-44fe-9616-d5e569bd4c3a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[51485d96-cc9f-4079-b45f-dbb435698f9d]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4245647-5823-4b20-aa60-ec19c4982561]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3507c1ce-c574-4fdf-896e-d9648cc6978b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062, portal: 172.16.0.220,3260]
Nov 30 08:09:02 user nova-compute[74963]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062, portal: 172.16.0.220,3260] successful.
Nov 30 08:09:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25be61-18b1-48b3-a03b-889f42dd6062 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8f1ff0-baac-4c82-9eb7-1770e8b0d686]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] <== disconnect_volume: return (318ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDczNgwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:02 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f5ad9-daf7-4514-95e0-740ce3dd7b55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:09:02 user nova-compute[74963]: No targets found.
Nov 30 08:09:02 user nova-compute[74963]: iSNS:
Nov 30 08:09:02 user nova-compute[74963]: No targets found.
Nov 30 08:09:02 user nova-compute[74963]: STATIC:
Nov 30 08:09:02 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb
Nov 30 08:09:02 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:02 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:02 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232
Nov 30 08:09:02 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:02 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:02 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650
Nov 30 08:09:02 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:02 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:02 user nova-compute[74963]: FIRMWARE:
Nov 30 08:09:02 user nova-compute[74963]: No targets found.
Nov 30 08:09:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:09:02 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:09:02 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[55305219-0dbb-40e1-90ff-53fa1dec06fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b2fd35-87bb-403e-be32-3a98db0dbc1f]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244388ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232'): ({'sde'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Removing single pathed devices sde {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5727991-706e-4c89-ac03-4df87b8e6cc2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2578e20-ce40-4c54-985a-4f04e3e1a325]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Flushing IO for device /dev/sde {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4b2137-a127-4acb-abbf-a0102c9dbe8f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f50cd-a5e7-4306-b8a8-1c38d52960e3]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e1170-c416-46db-96ab-ae30857e623a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:02 user nova-compute[74963]: INFO nova.compute.manager [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Terminating instance
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1f1ba5-1434-494e-b0d7-44fdfff0f703]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260]
Nov 30 08:09:02 user nova-compute[74963]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260] successful.
Nov 30 08:09:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67068e5-ad11-4054-8069-9adf63241fb8]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] <== disconnect_volume: return (323ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkrRAnxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '98e1c4f0-b628-435a-bf98-f814fa927873', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad1369df-f7ce-4c71-a775-e24b45c31650', 'serial'} {{(pid=74963) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] swap_volume: removing Cinder connection for volume 0a3b04f8-6848-4379-a798-0d0dc10a0232 {{(pid=74963) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-3fa535ad-d225-466a-a3b4-1fd365e8dfe7 req-fd219079-8972-4830-afe4-3bfa3d2a731a service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received event network-vif-unplugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3fa535ad-d225-466a-a3b4-1fd365e8dfe7 req-fd219079-8972-4830-afe4-3bfa3d2a731a service nova] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3fa535ad-d225-466a-a3b4-1fd365e8dfe7 req-fd219079-8972-4830-afe4-3bfa3d2a731a service nova] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3fa535ad-d225-466a-a3b4-1fd365e8dfe7 req-fd219079-8972-4830-afe4-3bfa3d2a731a service nova] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-3fa535ad-d225-466a-a3b4-1fd365e8dfe7 req-fd219079-8972-4830-afe4-3bfa3d2a731a service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] No waiting events found dispatching network-vif-unplugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-3fa535ad-d225-466a-a3b4-1fd365e8dfe7 req-fd219079-8972-4830-afe4-3bfa3d2a731a service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received event network-vif-unplugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lazy-loading 'flavor' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Instance destroyed successfully.
Nov 30 08:09:03 user nova-compute[74963]: DEBUG nova.objects.instance [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lazy-loading 'resources' on Instance uuid ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2f3c90b9-6efb-450f-906b-f69f66bcffc6 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.165s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1538004864',display_name='tempest-AttachSCSIVolumeTestJSON-server-1538004864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1538004864',id=5,image_ref='47cac5d5-780e-4b6c-9f79-7dffe3232b6f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhkg3y1tgIdZ3tkH+NQc2PrVfvtcEHgZgZLPIBi7glR9bP1ag2n7qASeezdmVHzYYC/2n71E/kOYBHj//K6irqh+85stqXhvqWIEt686En9TtxIJbBFzLN0AsE7404z7Q==',key_name='tempest-keypair-27342145',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b2b8cc5f69f422eb10f77b4c081f87a',ramdisk_id='',reservation_id='r-z1vjqixb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='47cac5d5-780e-4b6c-9f79-7dffe3232b6f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-708425414',owner_user_name='tempest-AttachSCSIVolumeTestJSON-708425414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6f08e40602c4a579125cb22746a521e',uuid=ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Converting VIF {"id": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "address": "fa:16:3e:a3:31:18", "network": {"id": "250dbef3-83c3-49cb-94f8-d7d625b14cca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-74196629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b2b8cc5f69f422eb10f77b4c081f87a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52e00e9-66", "ovs_interfaceid": "a52e00e9-66d0-4b80-b8f5-09aa9081e6c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:18,bridge_name='br-int',has_traffic_filtering=True,id=a52e00e9-66d0-4b80-b8f5-09aa9081e6c3,network=Network(250dbef3-83c3-49cb-94f8-d7d625b14cca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52e00e9-66') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG os_vif [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:18,bridge_name='br-int',has_traffic_filtering=True,id=a52e00e9-66d0-4b80-b8f5-09aa9081e6c3,network=Network(250dbef3-83c3-49cb-94f8-d7d625b14cca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52e00e9-66') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa52e00e9-66, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f36f2e5-8e6e-49bc-93f1-bbe634dd06ed) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:03 user nova-compute[74963]: INFO os_vif [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:18,bridge_name='br-int',has_traffic_filtering=True,id=a52e00e9-66d0-4b80-b8f5-09aa9081e6c3,network=Network(250dbef3-83c3-49cb-94f8-d7d625b14cca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52e00e9-66')
Nov 30 08:09:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Deleting instance files /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8_del
Nov 30 08:09:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Deletion of /opt/stack/data/nova/instances/ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8_del complete
Nov 30 08:09:03 user nova-compute[74963]: INFO nova.compute.manager [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 30 08:09:03 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "interface-6fec797d-1752-464f-8e89-3f1b21cda724-548f0039-1236-4fb1-bcbd-57351dad1f9a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "interface-6fec797d-1752-464f-8e89-3f1b21cda724-548f0039-1236-4fb1-bcbd-57351dad1f9a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.objects.instance [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lazy-loading 'flavor' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560530600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560530600',id=8,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIIMB50S1UrUdAIYurXG++T+DeKVYav11Y2BaKQ3ngEyQM/V5KCBuxUZ9zN/R/zlOKWamLw2XB6+Vkj/xUqSM+aCM6/ySzgbLvOn3nCdOOw3/wxulg0yoXKpuiKCLYag==',key_name='tempest-keypair-1537203754',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069409ef36774791b13e4a3eec8d6648',ramdisk_id='',reservation_id='r-zjozxt7j',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-834159471',owner_user_name='tempest-TaggedAttachmentsTest-834159471-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='644095bd2e894f0db86ed3a7d1a06c7a',uuid=6fec797d-1752-464f-8e89-3f1b21cda724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converting VIF {"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface> {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface> {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Attempting to detach device tap548f0039-12 from instance 6fec797d-1752-464f-8e89-3f1b21cda724 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] detach device xml: <interface type="ethernet">
Nov 30 08:09:04 user nova-compute[74963]:   <mac address="fa:16:3e:a9:8b:41"/>
Nov 30 08:09:04 user nova-compute[74963]:   <model type="virtio"/>
Nov 30 08:09:04 user nova-compute[74963]:   <mtu size="1442"/>
Nov 30 08:09:04 user nova-compute[74963]:   <target dev="tap548f0039-12"/>
Nov 30 08:09:04 user nova-compute[74963]: </interface>
Nov 30 08:09:04 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] swap_volume: Updating volume 0a3b04f8-6848-4379-a798-0d0dc10a0232 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "SkrRAnxj", "auth_password": "jbW7zZlVfOG6Ux", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "ad1369df-f7ce-4c71-a775-e24b45c31650"}, "status": "reserved", "instance": "98e1c4f0-b628-435a-bf98-f814fa927873", "attached_at": "", "detached_at": "", "volume_id": "ad1369df-f7ce-4c71-a775-e24b45c31650", "serial": "ad1369df-f7ce-4c71-a775-e24b45c31650"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ad1369df-f7ce-4c71-a775-e24b45c31650', 'no_device': None, 'attachment_id': 'dc8acf11-f289-44f9-a21b-e37f0513e956'} {{(pid=74963) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface> {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 30 08:09:04 user nova-compute[74963]:   <name>instance-00000008</name>
Nov 30 08:09:04 user nova-compute[74963]:   <uuid>6fec797d-1752-464f-8e89-3f1b21cda724</uuid>
Nov 30 08:09:04 user nova-compute[74963]:   <metadata>
Nov 30 08:09:04 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:09:04 user nova-compute[74963]:   <nova:package version="0.0.0"/>
Nov 30 08:09:04 user nova-compute[74963]:   <nova:name>tempest-device-tagging-server-1560530600</nova:name>
Nov 30 08:09:04 user nova-compute[74963]:   <nova:creationTime>2023-11-30 08:08:26</nova:creationTime>
Nov 30 08:09:04 user nova-compute[74963]:   <nova:flavor name="m1.tiny">
Nov 30 08:09:04 user nova-compute[74963]:     <nova:memory>512</nova:memory>
Nov 30 08:09:04 user nova-compute[74963]:     <nova:disk>1</nova:disk>
Nov 30 08:09:04 user nova-compute[74963]:     <nova:swap>0</nova:swap>
Nov 30 08:09:04 user nova-compute[74963]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:09:04 user nova-compute[74963]:     <nova:vcpus>1</nova:vcpus>
Nov 30 08:09:04 user nova-compute[74963]:   </nova:flavor>
Nov 30 08:09:04 user nova-compute[74963]:   <nova:owner>
Nov 30 08:09:04 user nova-compute[74963]:     <nova:user uuid="644095bd2e894f0db86ed3a7d1a06c7a">tempest-TaggedAttachmentsTest-834159471-project-member</nova:user>
Nov 30 08:09:04 user nova-compute[74963]:     <nova:project uuid="069409ef36774791b13e4a3eec8d6648">tempest-TaggedAttachmentsTest-834159471</nova:project>
Nov 30 08:09:04 user nova-compute[74963]:   </nova:owner>
Nov 30 08:09:04 user nova-compute[74963]:   <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:09:04 user nova-compute[74963]:   <nova:ports>
Nov 30 08:09:04 user nova-compute[74963]:     <nova:port uuid="662f4120-2ba1-466d-81b6-212565a16a9d">
Nov 30 08:09:04 user nova-compute[74963]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:09:04 user nova-compute[74963]:     </nova:port>
Nov 30 08:09:04 user nova-compute[74963]:     <nova:port uuid="548f0039-1236-4fb1-bcbd-57351dad1f9a">
Nov 30 08:09:04 user nova-compute[74963]:       <nova:ip type="fixed" address="10.10.10.126" ipVersion="4"/>
Nov 30 08:09:04 user nova-compute[74963]:     </nova:port>
Nov 30 08:09:04 user nova-compute[74963]:   </nova:ports>
Nov 30 08:09:04 user nova-compute[74963]: </nova:instance>
Nov 30 08:09:04 user nova-compute[74963]:   </metadata>
Nov 30 08:09:04 user nova-compute[74963]:   <memory unit='KiB'>524288</memory>
Nov 30 08:09:04 user nova-compute[74963]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 08:09:04 user nova-compute[74963]:   <vcpu placement='static'>1</vcpu>
Nov 30 08:09:04 user nova-compute[74963]:   <resource>
Nov 30 08:09:04 user nova-compute[74963]:     <partition>/machine</partition>
Nov 30 08:09:04 user nova-compute[74963]:   </resource>
Nov 30 08:09:04 user nova-compute[74963]:   <sysinfo type='smbios'>
Nov 30 08:09:04 user nova-compute[74963]:     <system>
Nov 30 08:09:04 user nova-compute[74963]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 08:09:04 user nova-compute[74963]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 08:09:04 user nova-compute[74963]:       <entry name='version'>0.0.0</entry>
Nov 30 08:09:04 user nova-compute[74963]:       <entry name='serial'>6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:09:04 user nova-compute[74963]:       <entry name='uuid'>6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:09:04 user nova-compute[74963]:       <entry name='family'>Virtual Machine</entry>
Nov 30 08:09:04 user nova-compute[74963]:     </system>
Nov 30 08:09:04 user nova-compute[74963]:   </sysinfo>
Nov 30 08:09:04 user nova-compute[74963]:   <os>
Nov 30 08:09:04 user nova-compute[74963]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 08:09:04 user nova-compute[74963]:     <boot dev='hd'/>
Nov 30 08:09:04 user nova-compute[74963]:     <smbios mode='sysinfo'/>
Nov 30 08:09:04 user nova-compute[74963]:   </os>
Nov 30 08:09:04 user nova-compute[74963]:   <features>
Nov 30 08:09:04 user nova-compute[74963]:     <acpi/>
Nov 30 08:09:04 user nova-compute[74963]:     <apic/>
Nov 30 08:09:04 user nova-compute[74963]:     <vmcoreinfo state='on'/>
Nov 30 08:09:04 user nova-compute[74963]:   </features>
Nov 30 08:09:04 user nova-compute[74963]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 08:09:04 user nova-compute[74963]:     <model fallback='forbid'>Nehalem</model>
Nov 30 08:09:04 user nova-compute[74963]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 08:09:04 user nova-compute[74963]:     <feature policy='require' name='vme'/>
Nov 30 08:09:04 user nova-compute[74963]:     <feature policy='require' name='x2apic'/>
Nov 30 08:09:04 user nova-compute[74963]:     <feature policy='require' name='hypervisor'/>
Nov 30 08:09:04 user nova-compute[74963]:   </cpu>
Nov 30 08:09:04 user nova-compute[74963]:   <clock offset='utc'>
Nov 30 08:09:04 user nova-compute[74963]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 08:09:04 user nova-compute[74963]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 08:09:04 user nova-compute[74963]:     <timer name='hpet' present='no'/>
Nov 30 08:09:04 user nova-compute[74963]:   </clock>
Nov 30 08:09:04 user nova-compute[74963]:   <on_poweroff>destroy</on_poweroff>
Nov 30 08:09:04 user nova-compute[74963]:   <on_reboot>restart</on_reboot>
Nov 30 08:09:04 user nova-compute[74963]:   <on_crash>destroy</on_crash>
Nov 30 08:09:04 user nova-compute[74963]:   <devices>
Nov 30 08:09:04 user nova-compute[74963]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 08:09:04 user nova-compute[74963]:     <disk type='file' device='disk'>
Nov 30 08:09:04 user nova-compute[74963]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 08:09:04 user nova-compute[74963]:       <source file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk' index='2'/>
Nov 30 08:09:04 user nova-compute[74963]:       <backingStore type='file' index='3'>
Nov 30 08:09:04 user nova-compute[74963]:         <format type='raw'/>
Nov 30 08:09:04 user nova-compute[74963]:         <source file='/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520'/>
Nov 30 08:09:04 user nova-compute[74963]:         <backingStore/>
Nov 30 08:09:04 user nova-compute[74963]:       </backingStore>
Nov 30 08:09:04 user nova-compute[74963]:       <target dev='vda' bus='virtio'/>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='virtio-disk0'/>
Nov 30 08:09:04 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </disk>
Nov 30 08:09:04 user nova-compute[74963]:     <disk type='file' device='cdrom'>
Nov 30 08:09:04 user nova-compute[74963]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 08:09:04 user nova-compute[74963]:       <source file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.config' index='1'/>
Nov 30 08:09:04 user nova-compute[74963]:       <backingStore/>
Nov 30 08:09:04 user nova-compute[74963]:       <target dev='hda' bus='ide'/>
Nov 30 08:09:04 user nova-compute[74963]:       <readonly/>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='ide0-0-0'/>
Nov 30 08:09:04 user nova-compute[74963]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </disk>
Nov 30 08:09:04 user nova-compute[74963]:     <controller type='usb' index='0' model='none'>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='usb'/>
Nov 30 08:09:04 user nova-compute[74963]:     </controller>
Nov 30 08:09:04 user nova-compute[74963]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='pci.0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </controller>
Nov 30 08:09:04 user nova-compute[74963]:     <controller type='ide' index='0'>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='ide'/>
Nov 30 08:09:04 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 08:09:04 user nova-compute[74963]:     </controller>
Nov 30 08:09:04 user nova-compute[74963]:     <interface type='ethernet'>
Nov 30 08:09:04 user nova-compute[74963]:       <mac address='fa:16:3e:15:71:ec'/>
Nov 30 08:09:04 user nova-compute[74963]:       <target dev='tap662f4120-2b'/>
Nov 30 08:09:04 user nova-compute[74963]:       <model type='virtio'/>
Nov 30 08:09:04 user nova-compute[74963]:       <mtu size='1442'/>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='net0'/>
Nov 30 08:09:04 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </interface>
Nov 30 08:09:04 user nova-compute[74963]:     <interface type='ethernet'>
Nov 30 08:09:04 user nova-compute[74963]:       <mac address='fa:16:3e:a9:8b:41'/>
Nov 30 08:09:04 user nova-compute[74963]:       <target dev='tap548f0039-12'/>
Nov 30 08:09:04 user nova-compute[74963]:       <model type='virtio'/>
Nov 30 08:09:04 user nova-compute[74963]:       <mtu size='1442'/>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='net1'/>
Nov 30 08:09:04 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </interface>
Nov 30 08:09:04 user nova-compute[74963]:     <serial type='pty'>
Nov 30 08:09:04 user nova-compute[74963]:       <source path='/dev/pts/7'/>
Nov 30 08:09:04 user nova-compute[74963]:       <log file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log' append='off'/>
Nov 30 08:09:04 user nova-compute[74963]:       <target type='isa-serial' port='0'>
Nov 30 08:09:04 user nova-compute[74963]:         <model name='isa-serial'/>
Nov 30 08:09:04 user nova-compute[74963]:       </target>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='serial0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </serial>
Nov 30 08:09:04 user nova-compute[74963]:     <console type='pty' tty='/dev/pts/7'>
Nov 30 08:09:04 user nova-compute[74963]:       <source path='/dev/pts/7'/>
Nov 30 08:09:04 user nova-compute[74963]:       <log file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log' append='off'/>
Nov 30 08:09:04 user nova-compute[74963]:       <target type='serial' port='0'/>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='serial0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </console>
Nov 30 08:09:04 user nova-compute[74963]:     <input type='mouse' bus='ps2'>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='input0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </input>
Nov 30 08:09:04 user nova-compute[74963]:     <input type='keyboard' bus='ps2'>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='input1'/>
Nov 30 08:09:04 user nova-compute[74963]:     </input>
Nov 30 08:09:04 user nova-compute[74963]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 30 08:09:04 user nova-compute[74963]:       <listen type='address' address='0.0.0.0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </graphics>
Nov 30 08:09:04 user nova-compute[74963]:     <audio id='1' type='none'/>
Nov 30 08:09:04 user nova-compute[74963]:     <video>
Nov 30 08:09:04 user nova-compute[74963]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='video0'/>
Nov 30 08:09:04 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </video>
Nov 30 08:09:04 user nova-compute[74963]:     <memballoon model='virtio'>
Nov 30 08:09:04 user nova-compute[74963]:       <stats period='10'/>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='balloon0'/>
Nov 30 08:09:04 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </memballoon>
Nov 30 08:09:04 user nova-compute[74963]:     <rng model='virtio'>
Nov 30 08:09:04 user nova-compute[74963]:       <backend model='random'>/dev/urandom</backend>
Nov 30 08:09:04 user nova-compute[74963]:       <alias name='rng0'/>
Nov 30 08:09:04 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 08:09:04 user nova-compute[74963]:     </rng>
Nov 30 08:09:04 user nova-compute[74963]:   </devices>
Nov 30 08:09:04 user nova-compute[74963]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 08:09:04 user nova-compute[74963]:     <label>libvirt-6fec797d-1752-464f-8e89-3f1b21cda724</label>
Nov 30 08:09:04 user nova-compute[74963]:     <imagelabel>libvirt-6fec797d-1752-464f-8e89-3f1b21cda724</imagelabel>
Nov 30 08:09:04 user nova-compute[74963]:   </seclabel>
Nov 30 08:09:04 user nova-compute[74963]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 08:09:04 user nova-compute[74963]:     <label>+64055:+108</label>
Nov 30 08:09:04 user nova-compute[74963]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 08:09:04 user nova-compute[74963]:   </seclabel>
Nov 30 08:09:04 user nova-compute[74963]: </domain>
Nov 30 08:09:04 user nova-compute[74963]:  {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 08:09:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Successfully detached device tap548f0039-12 from instance 6fec797d-1752-464f-8e89-3f1b21cda724 from the persistent domain config.
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] (1/8): Attempting to detach device tap548f0039-12 with device alias net1 from instance 6fec797d-1752-464f-8e89-3f1b21cda724 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] detach device xml: <interface type="ethernet">
Nov 30 08:09:04 user nova-compute[74963]:   <mac address="fa:16:3e:a9:8b:41"/>
Nov 30 08:09:04 user nova-compute[74963]:   <model type="virtio"/>
Nov 30 08:09:04 user nova-compute[74963]:   <mtu size="1442"/>
Nov 30 08:09:04 user nova-compute[74963]:   <target dev="tap548f0039-12"/>
Nov 30 08:09:04 user nova-compute[74963]: </interface>
Nov 30 08:09:04 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ecacd4d4-51fb-4f4a-a3b1-2a4856a126bc tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.396s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:04 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Took 1.08 seconds to deallocate network for instance.
Nov 30 08:09:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Start waiting for the detach event from libvirt for device tap548f0039-12 with device alias net1 for instance 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-b2dd58a0-7d49-467e-8574-6c123f845dd4 req-52a2bfa8-631b-4911-a10c-4692110b8398 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-unplugged-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b2dd58a0-7d49-467e-8574-6c123f845dd4 req-52a2bfa8-631b-4911-a10c-4692110b8398 service nova] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b2dd58a0-7d49-467e-8574-6c123f845dd4 req-52a2bfa8-631b-4911-a10c-4692110b8398 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b2dd58a0-7d49-467e-8574-6c123f845dd4 req-52a2bfa8-631b-4911-a10c-4692110b8398 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-b2dd58a0-7d49-467e-8574-6c123f845dd4 req-52a2bfa8-631b-4911-a10c-4692110b8398 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] No waiting events found dispatching network-vif-unplugged-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:04 user nova-compute[74963]: WARNING nova.compute.manager [req-b2dd58a0-7d49-467e-8574-6c123f845dd4 req-52a2bfa8-631b-4911-a10c-4692110b8398 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received unexpected event network-vif-unplugged-548f0039-1236-4fb1-bcbd-57351dad1f9a for instance with vm_state active and task_state None.
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-bc081957-2083-48e4-b70a-29588463d798 req-7b169f54-54c5-47d0-b298-9277403e5014 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received event network-vif-plugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bc081957-2083-48e4-b70a-29588463d798 req-7b169f54-54c5-47d0-b298-9277403e5014 service nova] Acquiring lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bc081957-2083-48e4-b70a-29588463d798 req-7b169f54-54c5-47d0-b298-9277403e5014 service nova] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bc081957-2083-48e4-b70a-29588463d798 req-7b169f54-54c5-47d0-b298-9277403e5014 service nova] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-bc081957-2083-48e4-b70a-29588463d798 req-7b169f54-54c5-47d0-b298-9277403e5014 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] No waiting events found dispatching network-vif-plugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:05 user nova-compute[74963]: WARNING nova.compute.manager [req-bc081957-2083-48e4-b70a-29588463d798 req-7b169f54-54c5-47d0-b298-9277403e5014 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received unexpected event network-vif-plugged-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 for instance with vm_state deleted and task_state None.
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-bc081957-2083-48e4-b70a-29588463d798 req-7b169f54-54c5-47d0-b298-9277403e5014 service nova] [instance: ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8] Received event network-vif-deleted-a52e00e9-66d0-4b80-b8f5-09aa9081e6c3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.279s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:09:05 user nova-compute[74963]: INFO nova.compute.claims [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Claim successful on node user
Nov 30 08:09:05 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Deleted allocations for instance ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-19d0d082-6ce8-479a-904b-9643c63a146b tempest-AttachSCSIVolumeTestJSON-708425414 tempest-AttachSCSIVolumeTestJSON-708425414-project-member] Lock "ff92c9a5-0a0d-4e5a-8ffa-2125d2abaea8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.694s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:09:05 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG nova.policy [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b110fcb508342509690b45e1854eb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce233bd757b64de4bd6f6abb3230da01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:09:05 user nova-compute[74963]: INFO nova.virt.block_device [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Booting with blank volume at /dev/vda
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG os_brick.utils [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1826a72-eca4-4f43-a6ca-44b0ea06518f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9b31e-bd2a-40fe-b801-0e176529245a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2931f991-f882-49b7-9920-de1806d94682]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c5e835-8689-4515-acc4-5889ddc7942b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:06 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4002840-6f48-403a-9f01-a4c4073cc656]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.utils [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:06 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9579e650-53bf-4772-888e-aa95a4108f75 is timed out.
Nov 30 08:09:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Successfully detached device vdb from instance 9579e650-53bf-4772-888e-aa95a4108f75 from the live domain config.
Nov 30 08:09:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUsSNWnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:06 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[427b4d37-07a5-4737-b897-cd9379365e29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:09:06 user nova-compute[74963]: No targets found.
Nov 30 08:09:06 user nova-compute[74963]: iSNS:
Nov 30 08:09:06 user nova-compute[74963]: No targets found.
Nov 30 08:09:06 user nova-compute[74963]: STATIC:
Nov 30 08:09:06 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb
Nov 30 08:09:06 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:06 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:06 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650
Nov 30 08:09:06 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:06 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:06 user nova-compute[74963]: FIRMWARE:
Nov 30 08:09:06 user nova-compute[74963]: No targets found.
Nov 30 08:09:06 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:09:06 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:09:06 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: INFO nova.compute.manager [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Swapping volume ad1369df-f7ce-4c71-a775-e24b45c31650 for 0a3b04f8-6848-4379-a798-0d0dc10a0232
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9235084e-d14d-47c9-b165-c30348aeb2c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4a3833-a87f-426c-b715-71a93a724f3e]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:09:06 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:06 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb (non-flash)
Nov 30 08:09:06 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:06 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622058e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb'): ({'sdd'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Removing single pathed devices sdd {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d35e4f1-1660-495d-9f56-be2a4152d8c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb7ab7c-af9b-4996-8cf8-9e0b2310dad5]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Flushing IO for device /dev/sdd {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01dee0a-11c6-48e0-83b8-9391996e188b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Successfully created port: 203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbe0a5c-5644-45fb-8926-65b7051515ae]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[716f795e-ef8b-49e9-ac40-52a7030144e3]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[534586bd-9ded-43bd-be21-fe88739e3fdd]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb, portal: 172.16.0.220,3260]
Nov 30 08:09:06 user nova-compute[74963]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb, portal: 172.16.0.220,3260] successful.
Nov 30 08:09:06 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c472ea78-420f-43b7-8674-0f2e4cf76abb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6d9353-ce28-43e4-9128-701af8e96496]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] <== disconnect_volume: return (350ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Successfully updated port: 203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-1f715508-8d8e-4818-9d9d-a4e51dfdfb1e req-42043fbd-8887-4c0a-8948-d5207ea58e58 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-plugged-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1f715508-8d8e-4818-9d9d-a4e51dfdfb1e req-42043fbd-8887-4c0a-8948-d5207ea58e58 service nova] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1f715508-8d8e-4818-9d9d-a4e51dfdfb1e req-42043fbd-8887-4c0a-8948-d5207ea58e58 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1f715508-8d8e-4818-9d9d-a4e51dfdfb1e req-42043fbd-8887-4c0a-8948-d5207ea58e58 service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-1f715508-8d8e-4818-9d9d-a4e51dfdfb1e req-42043fbd-8887-4c0a-8948-d5207ea58e58 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] No waiting events found dispatching network-vif-plugged-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:07 user nova-compute[74963]: WARNING nova.compute.manager [req-1f715508-8d8e-4818-9d9d-a4e51dfdfb1e req-42043fbd-8887-4c0a-8948-d5207ea58e58 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received unexpected event network-vif-plugged-548f0039-1236-4fb1-bcbd-57351dad1f9a for instance with vm_state active and task_state None.
Nov 30 08:09:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquired lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-d285dfe6-f416-4b06-af96-cbecdb2301f2 req-0523eec3-58cb-42dd-89fc-ea1cff41c83b service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-changed-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-d285dfe6-f416-4b06-af96-cbecdb2301f2 req-0523eec3-58cb-42dd-89fc-ea1cff41c83b service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Refreshing instance network info cache due to event network-changed-203987cf-1c90-44b7-9ca1-1eed9597d71a. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d285dfe6-f416-4b06-af96-cbecdb2301f2 req-0523eec3-58cb-42dd-89fc-ea1cff41c83b service nova] Acquiring lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.objects.instance [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lazy-loading 'flavor' on Instance uuid 9579e650-53bf-4772-888e-aa95a4108f75 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6ffb8996-d23c-4bbd-a97d-76469a97a16c tempest-VolumesAssistedSnapshotsTest-1409942591 tempest-VolumesAssistedSnapshotsTest-1409942591-project-admin] Lock "9579e650-53bf-4772-888e-aa95a4108f75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updating instance_info_cache with network_info: [{"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Releasing lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Instance network_info: |[{"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d285dfe6-f416-4b06-af96-cbecdb2301f2 req-0523eec3-58cb-42dd-89fc-ea1cff41c83b service nova] Acquired lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:09:07 user nova-compute[74963]: DEBUG nova.network.neutron [req-d285dfe6-f416-4b06-af96-cbecdb2301f2 req-0523eec3-58cb-42dd-89fc-ea1cff41c83b service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Refreshing network info cache for port 203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:09:08 user nova-compute[74963]: DEBUG nova.network.neutron [req-d285dfe6-f416-4b06-af96-cbecdb2301f2 req-0523eec3-58cb-42dd-89fc-ea1cff41c83b service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updated VIF entry in instance network info cache for port 203987cf-1c90-44b7-9ca1-1eed9597d71a. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:09:08 user nova-compute[74963]: DEBUG nova.network.neutron [req-d285dfe6-f416-4b06-af96-cbecdb2301f2 req-0523eec3-58cb-42dd-89fc-ea1cff41c83b service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updating instance_info_cache with network_info: [{"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d285dfe6-f416-4b06-af96-cbecdb2301f2 req-0523eec3-58cb-42dd-89fc-ea1cff41c83b service nova] Releasing lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:09:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG os_brick.utils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be2693-2419-4d3b-9f54-74469facaa9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[14621ad9-8771-406f-bd77-0009e026aefe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0566d17-dd32-4aa7-a4a9-800ff999b0b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6a36ba-bada-4428-8a7f-f638320604ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:11 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:09:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac78cbf-84cc-439d-9baa-ea8aa3c7bde0]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG os_brick.utils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:11 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updating existing volume attachment record: c7cba0fc-93cd-45de-988b-dba2ef9b4310 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:09:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-b4cb0c05-6171-459f-9ac6-d07c7b59d7f9 req-d2b5168d-0a5a-4fed-b85c-8a85baf7c241 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received event network-changed-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-b4cb0c05-6171-459f-9ac6-d07c7b59d7f9 req-d2b5168d-0a5a-4fed-b85c-8a85baf7c241 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Refreshing instance network info cache due to event network-changed-50c595ec-df34-4a59-9cce-177d50b6aa06. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:09:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b4cb0c05-6171-459f-9ac6-d07c7b59d7f9 req-d2b5168d-0a5a-4fed-b85c-8a85baf7c241 service nova] Acquiring lock "refresh_cache-7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:09:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b4cb0c05-6171-459f-9ac6-d07c7b59d7f9 req-d2b5168d-0a5a-4fed-b85c-8a85baf7c241 service nova] Acquired lock "refresh_cache-7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:09:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-b4cb0c05-6171-459f-9ac6-d07c7b59d7f9 req-d2b5168d-0a5a-4fed-b85c-8a85baf7c241 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Refreshing network info cache for port 50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:09:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-b4cb0c05-6171-459f-9ac6-d07c7b59d7f9 req-d2b5168d-0a5a-4fed-b85c-8a85baf7c241 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Updated VIF entry in instance network info cache for port 50c595ec-df34-4a59-9cce-177d50b6aa06. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:09:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-b4cb0c05-6171-459f-9ac6-d07c7b59d7f9 req-d2b5168d-0a5a-4fed-b85c-8a85baf7c241 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Updating instance_info_cache with network_info: [{"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b4cb0c05-6171-459f-9ac6-d07c7b59d7f9 req-d2b5168d-0a5a-4fed-b85c-8a85baf7c241 service nova] Releasing lock "refresh_cache-7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lazy-loading 'flavor' on Instance uuid 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:16 user nova-compute[74963]: INFO nova.compute.manager [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Attaching volume 26bbbfc2-6d8b-49fb-b802-f765c1da5f1a to /dev/vdb
Nov 30 08:09:16 user nova-compute[74963]: DEBUG os_brick.utils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d45219-c45d-4fe6-be0d-4ecf3137d33c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef4fb48-7e89-432e-9d60-6174dbea18bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[369136b3-b480-497e-b38f-d67a3e2f52dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae7414-649b-4672-9a3b-1ac1b2e180e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:16 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:09:16 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a62288-ddaf-4ed4-ab6b-24f9b9a4ba4c]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG os_brick.utils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:16 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Updating existing volume attachment record: 2799da4c-2733-4639-b614-eee4cca83d9f {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:09:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-95e31fb5-d533-426f-b299-470880228ff3 req-338066d2-ced2-4d58-be0e-5556eed4ac8e service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received event network-changed-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-95e31fb5-d533-426f-b299-470880228ff3 req-338066d2-ced2-4d58-be0e-5556eed4ac8e service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Refreshing instance network info cache due to event network-changed-53d952b1-3f88-45a5-9298-3d37b9335974. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:09:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-95e31fb5-d533-426f-b299-470880228ff3 req-338066d2-ced2-4d58-be0e-5556eed4ac8e service nova] Acquiring lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:09:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-95e31fb5-d533-426f-b299-470880228ff3 req-338066d2-ced2-4d58-be0e-5556eed4ac8e service nova] Acquired lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:09:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-95e31fb5-d533-426f-b299-470880228ff3 req-338066d2-ced2-4d58-be0e-5556eed4ac8e service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Refreshing network info cache for port 53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:09:23 user nova-compute[74963]: DEBUG nova.network.neutron [req-95e31fb5-d533-426f-b299-470880228ff3 req-338066d2-ced2-4d58-be0e-5556eed4ac8e service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Updated VIF entry in instance network info cache for port 53d952b1-3f88-45a5-9298-3d37b9335974. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:09:23 user nova-compute[74963]: DEBUG nova.network.neutron [req-95e31fb5-d533-426f-b299-470880228ff3 req-338066d2-ced2-4d58-be0e-5556eed4ac8e service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating instance_info_cache with network_info: [{"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-95e31fb5-d533-426f-b299-470880228ff3 req-338066d2-ced2-4d58-be0e-5556eed4ac8e service nova] Releasing lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:09:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:24 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Waiting for libvirt event about the detach of device tap548f0039-12 with device alias net1 from instance 6fec797d-1752-464f-8e89-3f1b21cda724 is timed out.
Nov 30 08:09:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface> {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 30 08:09:24 user nova-compute[74963]:   <name>instance-00000008</name>
Nov 30 08:09:24 user nova-compute[74963]:   <uuid>6fec797d-1752-464f-8e89-3f1b21cda724</uuid>
Nov 30 08:09:24 user nova-compute[74963]:   <metadata>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:09:24 user nova-compute[74963]:   <nova:package version="0.0.0"/>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:name>tempest-device-tagging-server-1560530600</nova:name>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:creationTime>2023-11-30 08:08:26</nova:creationTime>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:flavor name="m1.tiny">
Nov 30 08:09:24 user nova-compute[74963]:     <nova:memory>512</nova:memory>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:disk>1</nova:disk>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:swap>0</nova:swap>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:vcpus>1</nova:vcpus>
Nov 30 08:09:24 user nova-compute[74963]:   </nova:flavor>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:owner>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:user uuid="644095bd2e894f0db86ed3a7d1a06c7a">tempest-TaggedAttachmentsTest-834159471-project-member</nova:user>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:project uuid="069409ef36774791b13e4a3eec8d6648">tempest-TaggedAttachmentsTest-834159471</nova:project>
Nov 30 08:09:24 user nova-compute[74963]:   </nova:owner>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:ports>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:port uuid="662f4120-2ba1-466d-81b6-212565a16a9d">
Nov 30 08:09:24 user nova-compute[74963]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:09:24 user nova-compute[74963]:     </nova:port>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:port uuid="548f0039-1236-4fb1-bcbd-57351dad1f9a">
Nov 30 08:09:24 user nova-compute[74963]:       <nova:ip type="fixed" address="10.10.10.126" ipVersion="4"/>
Nov 30 08:09:24 user nova-compute[74963]:     </nova:port>
Nov 30 08:09:24 user nova-compute[74963]:   </nova:ports>
Nov 30 08:09:24 user nova-compute[74963]: </nova:instance>
Nov 30 08:09:24 user nova-compute[74963]:   </metadata>
Nov 30 08:09:24 user nova-compute[74963]:   <memory unit='KiB'>524288</memory>
Nov 30 08:09:24 user nova-compute[74963]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 08:09:24 user nova-compute[74963]:   <vcpu placement='static'>1</vcpu>
Nov 30 08:09:24 user nova-compute[74963]:   <resource>
Nov 30 08:09:24 user nova-compute[74963]:     <partition>/machine</partition>
Nov 30 08:09:24 user nova-compute[74963]:   </resource>
Nov 30 08:09:24 user nova-compute[74963]:   <sysinfo type='smbios'>
Nov 30 08:09:24 user nova-compute[74963]:     <system>
Nov 30 08:09:24 user nova-compute[74963]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 08:09:24 user nova-compute[74963]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 08:09:24 user nova-compute[74963]:       <entry name='version'>0.0.0</entry>
Nov 30 08:09:24 user nova-compute[74963]:       <entry name='serial'>6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:09:24 user nova-compute[74963]:       <entry name='uuid'>6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:09:24 user nova-compute[74963]:       <entry name='family'>Virtual Machine</entry>
Nov 30 08:09:24 user nova-compute[74963]:     </system>
Nov 30 08:09:24 user nova-compute[74963]:   </sysinfo>
Nov 30 08:09:24 user nova-compute[74963]:   <os>
Nov 30 08:09:24 user nova-compute[74963]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 08:09:24 user nova-compute[74963]:     <boot dev='hd'/>
Nov 30 08:09:24 user nova-compute[74963]:     <smbios mode='sysinfo'/>
Nov 30 08:09:24 user nova-compute[74963]:   </os>
Nov 30 08:09:24 user nova-compute[74963]:   <features>
Nov 30 08:09:24 user nova-compute[74963]:     <acpi/>
Nov 30 08:09:24 user nova-compute[74963]:     <apic/>
Nov 30 08:09:24 user nova-compute[74963]:     <vmcoreinfo state='on'/>
Nov 30 08:09:24 user nova-compute[74963]:   </features>
Nov 30 08:09:24 user nova-compute[74963]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 08:09:24 user nova-compute[74963]:     <model fallback='forbid'>Nehalem</model>
Nov 30 08:09:24 user nova-compute[74963]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 08:09:24 user nova-compute[74963]:     <feature policy='require' name='vme'/>
Nov 30 08:09:24 user nova-compute[74963]:     <feature policy='require' name='x2apic'/>
Nov 30 08:09:24 user nova-compute[74963]:     <feature policy='require' name='hypervisor'/>
Nov 30 08:09:24 user nova-compute[74963]:   </cpu>
Nov 30 08:09:24 user nova-compute[74963]:   <clock offset='utc'>
Nov 30 08:09:24 user nova-compute[74963]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 08:09:24 user nova-compute[74963]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 08:09:24 user nova-compute[74963]:     <timer name='hpet' present='no'/>
Nov 30 08:09:24 user nova-compute[74963]:   </clock>
Nov 30 08:09:24 user nova-compute[74963]:   <on_poweroff>destroy</on_poweroff>
Nov 30 08:09:24 user nova-compute[74963]:   <on_reboot>restart</on_reboot>
Nov 30 08:09:24 user nova-compute[74963]:   <on_crash>destroy</on_crash>
Nov 30 08:09:24 user nova-compute[74963]:   <devices>
Nov 30 08:09:24 user nova-compute[74963]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 08:09:24 user nova-compute[74963]:     <disk type='file' device='disk'>
Nov 30 08:09:24 user nova-compute[74963]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 08:09:24 user nova-compute[74963]:       <source file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk' index='2'/>
Nov 30 08:09:24 user nova-compute[74963]:       <backingStore type='file' index='3'>
Nov 30 08:09:24 user nova-compute[74963]:         <format type='raw'/>
Nov 30 08:09:24 user nova-compute[74963]:         <source file='/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520'/>
Nov 30 08:09:24 user nova-compute[74963]:         <backingStore/>
Nov 30 08:09:24 user nova-compute[74963]:       </backingStore>
Nov 30 08:09:24 user nova-compute[74963]:       <target dev='vda' bus='virtio'/>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='virtio-disk0'/>
Nov 30 08:09:24 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </disk>
Nov 30 08:09:24 user nova-compute[74963]:     <disk type='file' device='cdrom'>
Nov 30 08:09:24 user nova-compute[74963]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 08:09:24 user nova-compute[74963]:       <source file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.config' index='1'/>
Nov 30 08:09:24 user nova-compute[74963]:       <backingStore/>
Nov 30 08:09:24 user nova-compute[74963]:       <target dev='hda' bus='ide'/>
Nov 30 08:09:24 user nova-compute[74963]:       <readonly/>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='ide0-0-0'/>
Nov 30 08:09:24 user nova-compute[74963]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </disk>
Nov 30 08:09:24 user nova-compute[74963]:     <controller type='usb' index='0' model='none'>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='usb'/>
Nov 30 08:09:24 user nova-compute[74963]:     </controller>
Nov 30 08:09:24 user nova-compute[74963]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='pci.0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </controller>
Nov 30 08:09:24 user nova-compute[74963]:     <controller type='ide' index='0'>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='ide'/>
Nov 30 08:09:24 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 08:09:24 user nova-compute[74963]:     </controller>
Nov 30 08:09:24 user nova-compute[74963]:     <interface type='ethernet'>
Nov 30 08:09:24 user nova-compute[74963]:       <mac address='fa:16:3e:15:71:ec'/>
Nov 30 08:09:24 user nova-compute[74963]:       <target dev='tap662f4120-2b'/>
Nov 30 08:09:24 user nova-compute[74963]:       <model type='virtio'/>
Nov 30 08:09:24 user nova-compute[74963]:       <mtu size='1442'/>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='net0'/>
Nov 30 08:09:24 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </interface>
Nov 30 08:09:24 user nova-compute[74963]:     <serial type='pty'>
Nov 30 08:09:24 user nova-compute[74963]:       <source path='/dev/pts/7'/>
Nov 30 08:09:24 user nova-compute[74963]:       <log file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log' append='off'/>
Nov 30 08:09:24 user nova-compute[74963]:       <target type='isa-serial' port='0'>
Nov 30 08:09:24 user nova-compute[74963]:         <model name='isa-serial'/>
Nov 30 08:09:24 user nova-compute[74963]:       </target>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='serial0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </serial>
Nov 30 08:09:24 user nova-compute[74963]:     <console type='pty' tty='/dev/pts/7'>
Nov 30 08:09:24 user nova-compute[74963]:       <source path='/dev/pts/7'/>
Nov 30 08:09:24 user nova-compute[74963]:       <log file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log' append='off'/>
Nov 30 08:09:24 user nova-compute[74963]:       <target type='serial' port='0'/>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='serial0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </console>
Nov 30 08:09:24 user nova-compute[74963]:     <input type='mouse' bus='ps2'>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='input0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </input>
Nov 30 08:09:24 user nova-compute[74963]:     <input type='keyboard' bus='ps2'>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='input1'/>
Nov 30 08:09:24 user nova-compute[74963]:     </input>
Nov 30 08:09:24 user nova-compute[74963]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 30 08:09:24 user nova-compute[74963]:       <listen type='address' address='0.0.0.0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </graphics>
Nov 30 08:09:24 user nova-compute[74963]:     <audio id='1' type='none'/>
Nov 30 08:09:24 user nova-compute[74963]:     <video>
Nov 30 08:09:24 user nova-compute[74963]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='video0'/>
Nov 30 08:09:24 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </video>
Nov 30 08:09:24 user nova-compute[74963]:     <memballoon model='virtio'>
Nov 30 08:09:24 user nova-compute[74963]:       <stats period='10'/>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='balloon0'/>
Nov 30 08:09:24 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </memballoon>
Nov 30 08:09:24 user nova-compute[74963]:     <rng model='virtio'>
Nov 30 08:09:24 user nova-compute[74963]:       <backend model='random'>/dev/urandom</backend>
Nov 30 08:09:24 user nova-compute[74963]:       <alias name='rng0'/>
Nov 30 08:09:24 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 08:09:24 user nova-compute[74963]:     </rng>
Nov 30 08:09:24 user nova-compute[74963]:   </devices>
Nov 30 08:09:24 user nova-compute[74963]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 08:09:24 user nova-compute[74963]:     <label>libvirt-6fec797d-1752-464f-8e89-3f1b21cda724</label>
Nov 30 08:09:24 user nova-compute[74963]:     <imagelabel>libvirt-6fec797d-1752-464f-8e89-3f1b21cda724</imagelabel>
Nov 30 08:09:24 user nova-compute[74963]:   </seclabel>
Nov 30 08:09:24 user nova-compute[74963]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 08:09:24 user nova-compute[74963]:     <label>+64055:+108</label>
Nov 30 08:09:24 user nova-compute[74963]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 08:09:24 user nova-compute[74963]:   </seclabel>
Nov 30 08:09:24 user nova-compute[74963]: </domain>
Nov 30 08:09:24 user nova-compute[74963]:  {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 08:09:24 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Successfully detached device tap548f0039-12 from instance 6fec797d-1752-464f-8e89-3f1b21cda724 from the live domain config.
Nov 30 08:09:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560530600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560530600',id=8,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIIMB50S1UrUdAIYurXG++T+DeKVYav11Y2BaKQ3ngEyQM/V5KCBuxUZ9zN/R/zlOKWamLw2XB6+Vkj/xUqSM+aCM6/ySzgbLvOn3nCdOOw3/wxulg0yoXKpuiKCLYag==',key_name='tempest-keypair-1537203754',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069409ef36774791b13e4a3eec8d6648',ramdisk_id='',reservation_id='r-zjozxt7j',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-834159471',owner_user_name='tempest-TaggedAttachmentsTest-834159471-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='644095bd2e894f0db86ed3a7d1a06c7a',uuid=6fec797d-1752-464f-8e89-3f1b21cda724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converting VIF {"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG os_vif [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap548f0039-12, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa7eeaa4-e76e-4249-b0f6-6657e6ea3335) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:24 user nova-compute[74963]: INFO os_vif [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12')
Nov 30 08:09:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:09:24 user nova-compute[74963]:   <nova:package version="0.0.0"/>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:name>tempest-device-tagging-server-1560530600</nova:name>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:creationTime>2023-11-30 08:09:24</nova:creationTime>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:flavor name="m1.tiny">
Nov 30 08:09:24 user nova-compute[74963]:     <nova:memory>512</nova:memory>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:disk>1</nova:disk>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:swap>0</nova:swap>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:vcpus>1</nova:vcpus>
Nov 30 08:09:24 user nova-compute[74963]:   </nova:flavor>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:owner>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:user uuid="644095bd2e894f0db86ed3a7d1a06c7a">tempest-TaggedAttachmentsTest-834159471-project-member</nova:user>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:project uuid="069409ef36774791b13e4a3eec8d6648">tempest-TaggedAttachmentsTest-834159471</nova:project>
Nov 30 08:09:24 user nova-compute[74963]:   </nova:owner>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:09:24 user nova-compute[74963]:   <nova:ports>
Nov 30 08:09:24 user nova-compute[74963]:     <nova:port uuid="662f4120-2ba1-466d-81b6-212565a16a9d">
Nov 30 08:09:24 user nova-compute[74963]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:09:24 user nova-compute[74963]:     </nova:port>
Nov 30 08:09:24 user nova-compute[74963]:   </nova:ports>
Nov 30 08:09:24 user nova-compute[74963]: </nova:instance>
Nov 30 08:09:24 user nova-compute[74963]:  {{(pid=74963) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-deleted-548f0039-1236-4fb1-bcbd-57351dad1f9a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:26 user nova-compute[74963]: INFO nova.compute.manager [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Neutron deleted interface 548f0039-1236-4fb1-bcbd-57351dad1f9a; detaching it from the instance and deleting it from the info cache
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updating instance_info_cache with network_info: [{"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.objects.instance [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] Lazy-loading 'system_metadata' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquired lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.network.neutron [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.objects.instance [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] Lazy-loading 'flavor' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.objects.base [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] Object Instance<6fec797d-1752-464f-8e89-3f1b21cda724> lazy-loaded attributes: system_metadata,flavor {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560530600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560530600',id=8,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIIMB50S1UrUdAIYurXG++T+DeKVYav11Y2BaKQ3ngEyQM/V5KCBuxUZ9zN/R/zlOKWamLw2XB6+Vkj/xUqSM+aCM6/ySzgbLvOn3nCdOOw3/wxulg0yoXKpuiKCLYag==',key_name='tempest-keypair-1537203754',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069409ef36774791b13e4a3eec8d6648',ramdisk_id='',reservation_id='r-zjozxt7j',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-834159471',owner_user_name='tempest-TaggedAttachmentsTest-834159471-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='644095bd2e894f0db86ed3a7d1a06c7a',uuid=6fec797d-1752-464f-8e89-3f1b21cda724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] Converting VIF {"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface> {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 30 08:09:26 user nova-compute[74963]:   <name>instance-00000008</name>
Nov 30 08:09:26 user nova-compute[74963]:   <uuid>6fec797d-1752-464f-8e89-3f1b21cda724</uuid>
Nov 30 08:09:26 user nova-compute[74963]:   <metadata>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:09:26 user nova-compute[74963]:   <nova:package version="0.0.0"/>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:name>tempest-device-tagging-server-1560530600</nova:name>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:creationTime>2023-11-30 08:09:24</nova:creationTime>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:flavor name="m1.tiny">
Nov 30 08:09:26 user nova-compute[74963]:     <nova:memory>512</nova:memory>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:disk>1</nova:disk>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:swap>0</nova:swap>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:vcpus>1</nova:vcpus>
Nov 30 08:09:26 user nova-compute[74963]:   </nova:flavor>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:owner>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:user uuid="644095bd2e894f0db86ed3a7d1a06c7a">tempest-TaggedAttachmentsTest-834159471-project-member</nova:user>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:project uuid="069409ef36774791b13e4a3eec8d6648">tempest-TaggedAttachmentsTest-834159471</nova:project>
Nov 30 08:09:26 user nova-compute[74963]:   </nova:owner>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:ports>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:port uuid="662f4120-2ba1-466d-81b6-212565a16a9d">
Nov 30 08:09:26 user nova-compute[74963]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:09:26 user nova-compute[74963]:     </nova:port>
Nov 30 08:09:26 user nova-compute[74963]:   </nova:ports>
Nov 30 08:09:26 user nova-compute[74963]: </nova:instance>
Nov 30 08:09:26 user nova-compute[74963]:   </metadata>
Nov 30 08:09:26 user nova-compute[74963]:   <memory unit='KiB'>524288</memory>
Nov 30 08:09:26 user nova-compute[74963]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 08:09:26 user nova-compute[74963]:   <vcpu placement='static'>1</vcpu>
Nov 30 08:09:26 user nova-compute[74963]:   <resource>
Nov 30 08:09:26 user nova-compute[74963]:     <partition>/machine</partition>
Nov 30 08:09:26 user nova-compute[74963]:   </resource>
Nov 30 08:09:26 user nova-compute[74963]:   <sysinfo type='smbios'>
Nov 30 08:09:26 user nova-compute[74963]:     <system>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='version'>0.0.0</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='serial'>6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='uuid'>6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='family'>Virtual Machine</entry>
Nov 30 08:09:26 user nova-compute[74963]:     </system>
Nov 30 08:09:26 user nova-compute[74963]:   </sysinfo>
Nov 30 08:09:26 user nova-compute[74963]:   <os>
Nov 30 08:09:26 user nova-compute[74963]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 08:09:26 user nova-compute[74963]:     <boot dev='hd'/>
Nov 30 08:09:26 user nova-compute[74963]:     <smbios mode='sysinfo'/>
Nov 30 08:09:26 user nova-compute[74963]:   </os>
Nov 30 08:09:26 user nova-compute[74963]:   <features>
Nov 30 08:09:26 user nova-compute[74963]:     <acpi/>
Nov 30 08:09:26 user nova-compute[74963]:     <apic/>
Nov 30 08:09:26 user nova-compute[74963]:     <vmcoreinfo state='on'/>
Nov 30 08:09:26 user nova-compute[74963]:   </features>
Nov 30 08:09:26 user nova-compute[74963]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 08:09:26 user nova-compute[74963]:     <model fallback='forbid'>Nehalem</model>
Nov 30 08:09:26 user nova-compute[74963]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 08:09:26 user nova-compute[74963]:     <feature policy='require' name='vme'/>
Nov 30 08:09:26 user nova-compute[74963]:     <feature policy='require' name='x2apic'/>
Nov 30 08:09:26 user nova-compute[74963]:     <feature policy='require' name='hypervisor'/>
Nov 30 08:09:26 user nova-compute[74963]:   </cpu>
Nov 30 08:09:26 user nova-compute[74963]:   <clock offset='utc'>
Nov 30 08:09:26 user nova-compute[74963]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 08:09:26 user nova-compute[74963]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 08:09:26 user nova-compute[74963]:     <timer name='hpet' present='no'/>
Nov 30 08:09:26 user nova-compute[74963]:   </clock>
Nov 30 08:09:26 user nova-compute[74963]:   <on_poweroff>destroy</on_poweroff>
Nov 30 08:09:26 user nova-compute[74963]:   <on_reboot>restart</on_reboot>
Nov 30 08:09:26 user nova-compute[74963]:   <on_crash>destroy</on_crash>
Nov 30 08:09:26 user nova-compute[74963]:   <devices>
Nov 30 08:09:26 user nova-compute[74963]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 08:09:26 user nova-compute[74963]:     <disk type='file' device='disk'>
Nov 30 08:09:26 user nova-compute[74963]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 08:09:26 user nova-compute[74963]:       <source file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk' index='2'/>
Nov 30 08:09:26 user nova-compute[74963]:       <backingStore type='file' index='3'>
Nov 30 08:09:26 user nova-compute[74963]:         <format type='raw'/>
Nov 30 08:09:26 user nova-compute[74963]:         <source file='/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520'/>
Nov 30 08:09:26 user nova-compute[74963]:         <backingStore/>
Nov 30 08:09:26 user nova-compute[74963]:       </backingStore>
Nov 30 08:09:26 user nova-compute[74963]:       <target dev='vda' bus='virtio'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='virtio-disk0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </disk>
Nov 30 08:09:26 user nova-compute[74963]:     <disk type='file' device='cdrom'>
Nov 30 08:09:26 user nova-compute[74963]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 08:09:26 user nova-compute[74963]:       <source file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.config' index='1'/>
Nov 30 08:09:26 user nova-compute[74963]:       <backingStore/>
Nov 30 08:09:26 user nova-compute[74963]:       <target dev='hda' bus='ide'/>
Nov 30 08:09:26 user nova-compute[74963]:       <readonly/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='ide0-0-0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </disk>
Nov 30 08:09:26 user nova-compute[74963]:     <controller type='usb' index='0' model='none'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='usb'/>
Nov 30 08:09:26 user nova-compute[74963]:     </controller>
Nov 30 08:09:26 user nova-compute[74963]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='pci.0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </controller>
Nov 30 08:09:26 user nova-compute[74963]:     <controller type='ide' index='0'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='ide'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 08:09:26 user nova-compute[74963]:     </controller>
Nov 30 08:09:26 user nova-compute[74963]:     <interface type='ethernet'>
Nov 30 08:09:26 user nova-compute[74963]:       <mac address='fa:16:3e:15:71:ec'/>
Nov 30 08:09:26 user nova-compute[74963]:       <target dev='tap662f4120-2b'/>
Nov 30 08:09:26 user nova-compute[74963]:       <model type='virtio'/>
Nov 30 08:09:26 user nova-compute[74963]:       <mtu size='1442'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='net0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </interface>
Nov 30 08:09:26 user nova-compute[74963]:     <serial type='pty'>
Nov 30 08:09:26 user nova-compute[74963]:       <source path='/dev/pts/7'/>
Nov 30 08:09:26 user nova-compute[74963]:       <log file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log' append='off'/>
Nov 30 08:09:26 user nova-compute[74963]:       <target type='isa-serial' port='0'>
Nov 30 08:09:26 user nova-compute[74963]:         <model name='isa-serial'/>
Nov 30 08:09:26 user nova-compute[74963]:       </target>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='serial0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </serial>
Nov 30 08:09:26 user nova-compute[74963]:     <console type='pty' tty='/dev/pts/7'>
Nov 30 08:09:26 user nova-compute[74963]:       <source path='/dev/pts/7'/>
Nov 30 08:09:26 user nova-compute[74963]:       <log file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log' append='off'/>
Nov 30 08:09:26 user nova-compute[74963]:       <target type='serial' port='0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='serial0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </console>
Nov 30 08:09:26 user nova-compute[74963]:     <input type='mouse' bus='ps2'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='input0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </input>
Nov 30 08:09:26 user nova-compute[74963]:     <input type='keyboard' bus='ps2'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='input1'/>
Nov 30 08:09:26 user nova-compute[74963]:     </input>
Nov 30 08:09:26 user nova-compute[74963]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 30 08:09:26 user nova-compute[74963]:       <listen type='address' address='0.0.0.0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </graphics>
Nov 30 08:09:26 user nova-compute[74963]:     <audio id='1' type='none'/>
Nov 30 08:09:26 user nova-compute[74963]:     <video>
Nov 30 08:09:26 user nova-compute[74963]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='video0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </video>
Nov 30 08:09:26 user nova-compute[74963]:     <memballoon model='virtio'>
Nov 30 08:09:26 user nova-compute[74963]:       <stats period='10'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='balloon0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </memballoon>
Nov 30 08:09:26 user nova-compute[74963]:     <rng model='virtio'>
Nov 30 08:09:26 user nova-compute[74963]:       <backend model='random'>/dev/urandom</backend>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='rng0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </rng>
Nov 30 08:09:26 user nova-compute[74963]:   </devices>
Nov 30 08:09:26 user nova-compute[74963]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 08:09:26 user nova-compute[74963]:     <label>libvirt-6fec797d-1752-464f-8e89-3f1b21cda724</label>
Nov 30 08:09:26 user nova-compute[74963]:     <imagelabel>libvirt-6fec797d-1752-464f-8e89-3f1b21cda724</imagelabel>
Nov 30 08:09:26 user nova-compute[74963]:   </seclabel>
Nov 30 08:09:26 user nova-compute[74963]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 08:09:26 user nova-compute[74963]:     <label>+64055:+108</label>
Nov 30 08:09:26 user nova-compute[74963]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 08:09:26 user nova-compute[74963]:   </seclabel>
Nov 30 08:09:26 user nova-compute[74963]: </domain>
Nov 30 08:09:26 user nova-compute[74963]:  {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface> {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a9:8b:41"/><model type="virtio"/><mtu size="1442"/><target dev="tap548f0039-12"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 30 08:09:26 user nova-compute[74963]:   <name>instance-00000008</name>
Nov 30 08:09:26 user nova-compute[74963]:   <uuid>6fec797d-1752-464f-8e89-3f1b21cda724</uuid>
Nov 30 08:09:26 user nova-compute[74963]:   <metadata>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:09:26 user nova-compute[74963]:   <nova:package version="0.0.0"/>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:name>tempest-device-tagging-server-1560530600</nova:name>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:creationTime>2023-11-30 08:09:24</nova:creationTime>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:flavor name="m1.tiny">
Nov 30 08:09:26 user nova-compute[74963]:     <nova:memory>512</nova:memory>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:disk>1</nova:disk>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:swap>0</nova:swap>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:vcpus>1</nova:vcpus>
Nov 30 08:09:26 user nova-compute[74963]:   </nova:flavor>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:owner>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:user uuid="644095bd2e894f0db86ed3a7d1a06c7a">tempest-TaggedAttachmentsTest-834159471-project-member</nova:user>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:project uuid="069409ef36774791b13e4a3eec8d6648">tempest-TaggedAttachmentsTest-834159471</nova:project>
Nov 30 08:09:26 user nova-compute[74963]:   </nova:owner>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:ports>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:port uuid="662f4120-2ba1-466d-81b6-212565a16a9d">
Nov 30 08:09:26 user nova-compute[74963]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:09:26 user nova-compute[74963]:     </nova:port>
Nov 30 08:09:26 user nova-compute[74963]:   </nova:ports>
Nov 30 08:09:26 user nova-compute[74963]: </nova:instance>
Nov 30 08:09:26 user nova-compute[74963]:   </metadata>
Nov 30 08:09:26 user nova-compute[74963]:   <memory unit='KiB'>524288</memory>
Nov 30 08:09:26 user nova-compute[74963]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 08:09:26 user nova-compute[74963]:   <vcpu placement='static'>1</vcpu>
Nov 30 08:09:26 user nova-compute[74963]:   <resource>
Nov 30 08:09:26 user nova-compute[74963]:     <partition>/machine</partition>
Nov 30 08:09:26 user nova-compute[74963]:   </resource>
Nov 30 08:09:26 user nova-compute[74963]:   <sysinfo type='smbios'>
Nov 30 08:09:26 user nova-compute[74963]:     <system>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='version'>0.0.0</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='serial'>6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='uuid'>6fec797d-1752-464f-8e89-3f1b21cda724</entry>
Nov 30 08:09:26 user nova-compute[74963]:       <entry name='family'>Virtual Machine</entry>
Nov 30 08:09:26 user nova-compute[74963]:     </system>
Nov 30 08:09:26 user nova-compute[74963]:   </sysinfo>
Nov 30 08:09:26 user nova-compute[74963]:   <os>
Nov 30 08:09:26 user nova-compute[74963]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 08:09:26 user nova-compute[74963]:     <boot dev='hd'/>
Nov 30 08:09:26 user nova-compute[74963]:     <smbios mode='sysinfo'/>
Nov 30 08:09:26 user nova-compute[74963]:   </os>
Nov 30 08:09:26 user nova-compute[74963]:   <features>
Nov 30 08:09:26 user nova-compute[74963]:     <acpi/>
Nov 30 08:09:26 user nova-compute[74963]:     <apic/>
Nov 30 08:09:26 user nova-compute[74963]:     <vmcoreinfo state='on'/>
Nov 30 08:09:26 user nova-compute[74963]:   </features>
Nov 30 08:09:26 user nova-compute[74963]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 08:09:26 user nova-compute[74963]:     <model fallback='forbid'>Nehalem</model>
Nov 30 08:09:26 user nova-compute[74963]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 08:09:26 user nova-compute[74963]:     <feature policy='require' name='vme'/>
Nov 30 08:09:26 user nova-compute[74963]:     <feature policy='require' name='x2apic'/>
Nov 30 08:09:26 user nova-compute[74963]:     <feature policy='require' name='hypervisor'/>
Nov 30 08:09:26 user nova-compute[74963]:   </cpu>
Nov 30 08:09:26 user nova-compute[74963]:   <clock offset='utc'>
Nov 30 08:09:26 user nova-compute[74963]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 08:09:26 user nova-compute[74963]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 08:09:26 user nova-compute[74963]:     <timer name='hpet' present='no'/>
Nov 30 08:09:26 user nova-compute[74963]:   </clock>
Nov 30 08:09:26 user nova-compute[74963]:   <on_poweroff>destroy</on_poweroff>
Nov 30 08:09:26 user nova-compute[74963]:   <on_reboot>restart</on_reboot>
Nov 30 08:09:26 user nova-compute[74963]:   <on_crash>destroy</on_crash>
Nov 30 08:09:26 user nova-compute[74963]:   <devices>
Nov 30 08:09:26 user nova-compute[74963]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 08:09:26 user nova-compute[74963]:     <disk type='file' device='disk'>
Nov 30 08:09:26 user nova-compute[74963]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 08:09:26 user nova-compute[74963]:       <source file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk' index='2'/>
Nov 30 08:09:26 user nova-compute[74963]:       <backingStore type='file' index='3'>
Nov 30 08:09:26 user nova-compute[74963]:         <format type='raw'/>
Nov 30 08:09:26 user nova-compute[74963]:         <source file='/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520'/>
Nov 30 08:09:26 user nova-compute[74963]:         <backingStore/>
Nov 30 08:09:26 user nova-compute[74963]:       </backingStore>
Nov 30 08:09:26 user nova-compute[74963]:       <target dev='vda' bus='virtio'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='virtio-disk0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </disk>
Nov 30 08:09:26 user nova-compute[74963]:     <disk type='file' device='cdrom'>
Nov 30 08:09:26 user nova-compute[74963]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 08:09:26 user nova-compute[74963]:       <source file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/disk.config' index='1'/>
Nov 30 08:09:26 user nova-compute[74963]:       <backingStore/>
Nov 30 08:09:26 user nova-compute[74963]:       <target dev='hda' bus='ide'/>
Nov 30 08:09:26 user nova-compute[74963]:       <readonly/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='ide0-0-0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </disk>
Nov 30 08:09:26 user nova-compute[74963]:     <controller type='usb' index='0' model='none'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='usb'/>
Nov 30 08:09:26 user nova-compute[74963]:     </controller>
Nov 30 08:09:26 user nova-compute[74963]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='pci.0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </controller>
Nov 30 08:09:26 user nova-compute[74963]:     <controller type='ide' index='0'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='ide'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 08:09:26 user nova-compute[74963]:     </controller>
Nov 30 08:09:26 user nova-compute[74963]:     <interface type='ethernet'>
Nov 30 08:09:26 user nova-compute[74963]:       <mac address='fa:16:3e:15:71:ec'/>
Nov 30 08:09:26 user nova-compute[74963]:       <target dev='tap662f4120-2b'/>
Nov 30 08:09:26 user nova-compute[74963]:       <model type='virtio'/>
Nov 30 08:09:26 user nova-compute[74963]:       <mtu size='1442'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='net0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </interface>
Nov 30 08:09:26 user nova-compute[74963]:     <serial type='pty'>
Nov 30 08:09:26 user nova-compute[74963]:       <source path='/dev/pts/7'/>
Nov 30 08:09:26 user nova-compute[74963]:       <log file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log' append='off'/>
Nov 30 08:09:26 user nova-compute[74963]:       <target type='isa-serial' port='0'>
Nov 30 08:09:26 user nova-compute[74963]:         <model name='isa-serial'/>
Nov 30 08:09:26 user nova-compute[74963]:       </target>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='serial0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </serial>
Nov 30 08:09:26 user nova-compute[74963]:     <console type='pty' tty='/dev/pts/7'>
Nov 30 08:09:26 user nova-compute[74963]:       <source path='/dev/pts/7'/>
Nov 30 08:09:26 user nova-compute[74963]:       <log file='/opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724/console.log' append='off'/>
Nov 30 08:09:26 user nova-compute[74963]:       <target type='serial' port='0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='serial0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </console>
Nov 30 08:09:26 user nova-compute[74963]:     <input type='mouse' bus='ps2'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='input0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </input>
Nov 30 08:09:26 user nova-compute[74963]:     <input type='keyboard' bus='ps2'>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='input1'/>
Nov 30 08:09:26 user nova-compute[74963]:     </input>
Nov 30 08:09:26 user nova-compute[74963]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 30 08:09:26 user nova-compute[74963]:       <listen type='address' address='0.0.0.0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </graphics>
Nov 30 08:09:26 user nova-compute[74963]:     <audio id='1' type='none'/>
Nov 30 08:09:26 user nova-compute[74963]:     <video>
Nov 30 08:09:26 user nova-compute[74963]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='video0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </video>
Nov 30 08:09:26 user nova-compute[74963]:     <memballoon model='virtio'>
Nov 30 08:09:26 user nova-compute[74963]:       <stats period='10'/>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='balloon0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </memballoon>
Nov 30 08:09:26 user nova-compute[74963]:     <rng model='virtio'>
Nov 30 08:09:26 user nova-compute[74963]:       <backend model='random'>/dev/urandom</backend>
Nov 30 08:09:26 user nova-compute[74963]:       <alias name='rng0'/>
Nov 30 08:09:26 user nova-compute[74963]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 08:09:26 user nova-compute[74963]:     </rng>
Nov 30 08:09:26 user nova-compute[74963]:   </devices>
Nov 30 08:09:26 user nova-compute[74963]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 08:09:26 user nova-compute[74963]:     <label>libvirt-6fec797d-1752-464f-8e89-3f1b21cda724</label>
Nov 30 08:09:26 user nova-compute[74963]:     <imagelabel>libvirt-6fec797d-1752-464f-8e89-3f1b21cda724</imagelabel>
Nov 30 08:09:26 user nova-compute[74963]:   </seclabel>
Nov 30 08:09:26 user nova-compute[74963]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 08:09:26 user nova-compute[74963]:     <label>+64055:+108</label>
Nov 30 08:09:26 user nova-compute[74963]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 08:09:26 user nova-compute[74963]:   </seclabel>
Nov 30 08:09:26 user nova-compute[74963]: </domain>
Nov 30 08:09:26 user nova-compute[74963]:  {{(pid=74963) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 08:09:26 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Detaching interface fa:16:3e:a9:8b:41 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap548f0039-12' not found.
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560530600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560530600',id=8,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIIMB50S1UrUdAIYurXG++T+DeKVYav11Y2BaKQ3ngEyQM/V5KCBuxUZ9zN/R/zlOKWamLw2XB6+Vkj/xUqSM+aCM6/ySzgbLvOn3nCdOOw3/wxulg0yoXKpuiKCLYag==',key_name='tempest-keypair-1537203754',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069409ef36774791b13e4a3eec8d6648',ramdisk_id='',reservation_id='r-zjozxt7j',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-834159471',owner_user_name='tempest-TaggedAttachmentsTest-834159471-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='644095bd2e894f0db86ed3a7d1a06c7a',uuid=6fec797d-1752-464f-8e89-3f1b21cda724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] Converting VIF {"id": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "address": "fa:16:3e:a9:8b:41", "network": {"id": "9fbff47d-e467-409b-9dc7-af5418a78632", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-989283161", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548f0039-12", "ovs_interfaceid": "548f0039-1236-4fb1-bcbd-57351dad1f9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG os_vif [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap548f0039-12, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:09:26 user nova-compute[74963]: INFO os_vif [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:8b:41,bridge_name='br-int',has_traffic_filtering=True,id=548f0039-1236-4fb1-bcbd-57351dad1f9a,network=Network(9fbff47d-e467-409b-9dc7-af5418a78632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548f0039-12')
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [req-2d65727d-c7f6-49ef-9b92-f49d3e6fa75a req-bdb4594a-f450-4d10-b80d-e9581735a1ad service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:09:26 user nova-compute[74963]:   <nova:package version="0.0.0"/>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:name>tempest-device-tagging-server-1560530600</nova:name>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:creationTime>2023-11-30 08:09:26</nova:creationTime>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:flavor name="m1.tiny">
Nov 30 08:09:26 user nova-compute[74963]:     <nova:memory>512</nova:memory>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:disk>1</nova:disk>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:swap>0</nova:swap>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:vcpus>1</nova:vcpus>
Nov 30 08:09:26 user nova-compute[74963]:   </nova:flavor>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:owner>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:user uuid="644095bd2e894f0db86ed3a7d1a06c7a">tempest-TaggedAttachmentsTest-834159471-project-member</nova:user>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:project uuid="069409ef36774791b13e4a3eec8d6648">tempest-TaggedAttachmentsTest-834159471</nova:project>
Nov 30 08:09:26 user nova-compute[74963]:   </nova:owner>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:09:26 user nova-compute[74963]:   <nova:ports>
Nov 30 08:09:26 user nova-compute[74963]:     <nova:port uuid="662f4120-2ba1-466d-81b6-212565a16a9d">
Nov 30 08:09:26 user nova-compute[74963]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:09:26 user nova-compute[74963]:     </nova:port>
Nov 30 08:09:26 user nova-compute[74963]:   </nova:ports>
Nov 30 08:09:26 user nova-compute[74963]: </nova:instance>
Nov 30 08:09:26 user nova-compute[74963]:  {{(pid=74963) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG nova.network.neutron [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updating instance_info_cache with network_info: [{"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Releasing lock "refresh_cache-6fec797d-1752-464f-8e89-3f1b21cda724" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:09:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b52cce89-2127-4362-92a3-1d757fafd9ea tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "interface-6fec797d-1752-464f-8e89-3f1b21cda724-548f0039-1236-4fb1-bcbd-57351dad1f9a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 23.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDczNgwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98e1c4f0-b628-435a-bf98-f814fa927873', 'attached_at': '', 'detached_at': '', 'volume_id': '0a3b04f8-6848-4379-a798-0d0dc10a0232', 'serial': '0a3b04f8-6848-4379-a798-0d0dc10a0232'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkrRAnxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'ad1369df-f7ce-4c71-a775-e24b45c31650'}, 'status': 'reserved', 'instance': '98e1c4f0-b628-435a-bf98-f814fa927873', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad1369df-f7ce-4c71-a775-e24b45c31650', 'serial'} {{(pid=74963) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDczNgwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:35 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:35 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:35 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c5ae67-77f6-4ee3-be51-27894bf699c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:09:35 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0bc64a-06b9-472b-8ccd-423fee69a866]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232] added
Nov 30 08:09:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26858cb-26c2-4843-b649-db13e20597ca]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4783f093-131a-42a7-b597-6fe9af7f6d1e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDczNgwv {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDczNgwv" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa12530b-4bff-47da-94d6-983fed28396e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WDczNgwv'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f344d358-453a-4d5f-8242-5007f00c048f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ca4de9-0793-4858-92a3-e1af0be6854e]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5219f9da-86c4-48b8-91ab-953d5fc7a166]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260]
Nov 30 08:09:36 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260] successful.
Nov 30 08:09:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca1781-2982-4181-a92b-d36483b1f8ad]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc054be1-cd9f-4bf2-a38a-b10516814734]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:36 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:36 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8ba50f-b5eb-4583-ad17-df7202d46156]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAMcXVlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:36 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:09:36 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Creating image(s)
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Ensure instance console log exists: /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Start _get_guest_xml network_info=[{"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzJfqBWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70392773-3fa7-4fb1-8513-9f0391f9e0e0', 'attached_at': '', 'detached_at': '', 'volume_id': '959c79f1-2657-4e31-9f80-c2c7f120d46f', 'serial': '959c79f1-2657-4e31-9f80-c2c7f120d46f'}, 'attachment_id': 'c7cba0fc-93cd-45de-988b-dba2ef9b4310', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:09:36 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:09:36 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzJfqBWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:36 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDczNgwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26231643239656366', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231643239656366', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.872s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:37 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:37 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG nova.objects.instance [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lazy-loading 'flavor' on Instance uuid 98e1c4f0-b628-435a-bf98-f814fa927873 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b66915-e856-459b-806a-1d4128d5b23d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:09:37 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05288d8-9ccb-4cc1-85d1-c73dfb8c5969]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a] added
Nov 30 08:09:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40418ec-4a49-4539-887a-c8575d7a2edd]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fbb422-2264-4e5d-829f-60df5d2764dc]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAMcXVlY {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAMcXVlY" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de0dd5f-846d-412d-9a7d-0bc20b82e96a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RAMcXVlY'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a239973-a1a0-4425-9329-5eb525bee1dd]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f601cb8-2576-4578-abc1-b8e86ea50753]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:37 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:37 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f43698e-29bf-478f-8394-508855980491]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a, portal: 172.16.0.220,3260]
Nov 30 08:09:37 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a, portal: 172.16.0.220,3260] successful.
Nov 30 08:09:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca60247c-1baf-4153-8c11-dffdafbc4433]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[629eb60e-545a-44ff-957f-8ed2e7278271]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:37 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:37 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:37 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:37 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bdddf3-735d-4487-8b1a-73d61300c6a0]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: None {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:09:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 162529280 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAMcXVlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] <== connect_volume: return (2184ms) {'type': 'block', 'scsi_wwn': '26362356261316263', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362356261316263', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.836s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:38 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:38 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lazy-loading 'flavor' on Instance uuid 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e24e6-a902-4165-824b-a5f3168b7a2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:09:38 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:09:38 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:09:38 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:09:38 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:09:38 user nova-compute[74963]:   <serial>26bbbfc2-6d8b-49fb-b802-f765c1da5f1a</serial>
Nov 30 08:09:38 user nova-compute[74963]: </disk>
Nov 30 08:09:38 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[46603141-8351-4af2-9b8c-62f10617e3b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f] added
Nov 30 08:09:38 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d20c61-8e72-44ee-bb1d-837f47d06bc8]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 317718528 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c9d23e-7af0-4517-bb8d-a48b8b3a6f5a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzJfqBWG {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzJfqBWG" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2605cfd1-c7d7-4c22-b17f-1c0a280aea19]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jzJfqBWG'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[281f2ea0-a1a5-42d0-8ce7-18914424889a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6268d42c-572c-47aa-ac3a-ac3fb6b901fe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:38 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:38 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:38 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:38 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:38 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:38 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 435159040 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] No VIF found with MAC fa:16:3e:3b:ec:0f, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a821dde8-5186-4ca0-940c-d4fdad4332f1 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.096s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 600834048 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --login" returned: 0 in 1.096s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70092f7-84e5-42d8-9c5d-ccca5d993def]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f, portal: 172.16.0.220,3260]
Nov 30 08:09:39 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f, portal: 172.16.0.220,3260] successful.
Nov 30 08:09:39 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbcda84-cb1e-4fc4-8f74-c482d5c9a54a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d61c9b6-236c-44b1-9af7-ae104330d6d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:39 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:09:39 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:39 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:39 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:39 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:09:39 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:39 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:39 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.477s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bd25de-112f-4629-9eae-4c233f1d90be]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:39 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: None {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:09:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 756023296 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 889192448 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:40 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:09:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzJfqBWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:09:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.515s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] <== connect_volume: return (4351ms) {'type': 'block', 'scsi_wwn': '23930656235383731', 'path': '/dev/sdd'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930656235383731', 'path': '/dev/sdd'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:09:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074003933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074003933',id=12,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-vnr2mkxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:09:06Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=70392773-3fa7-4fb1-8513-9f0391f9e0e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=203987cf-1c90-44b7-9ca1-1eed9597d71a,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203987cf-1c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'pci_devices' on Instance uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:09:41 user nova-compute[74963]:   <uuid>70392773-3fa7-4fb1-8513-9f0391f9e0e0</uuid>
Nov 30 08:09:41 user nova-compute[74963]:   <name>instance-0000000c</name>
Nov 30 08:09:41 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:09:41 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:09:41 user nova-compute[74963]:   <metadata>
Nov 30 08:09:41 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:09:41 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:09:41 user nova-compute[74963]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1074003933</nova:name>
Nov 30 08:09:41 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:09:36</nova:creationTime>
Nov 30 08:09:41 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:09:41 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:09:41 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:09:41 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:09:41 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:09:41 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:09:41 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:09:41 user nova-compute[74963]:       <nova:owner>
Nov 30 08:09:41 user nova-compute[74963]:         <nova:user uuid="4b110fcb508342509690b45e1854eb81">tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member</nova:user>
Nov 30 08:09:41 user nova-compute[74963]:         <nova:project uuid="ce233bd757b64de4bd6f6abb3230da01">tempest-ServerBootFromVolumeStableRescueTest-1834985655</nova:project>
Nov 30 08:09:41 user nova-compute[74963]:       </nova:owner>
Nov 30 08:09:41 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:09:41 user nova-compute[74963]:       <nova:ports>
Nov 30 08:09:41 user nova-compute[74963]:         <nova:port uuid="203987cf-1c90-44b7-9ca1-1eed9597d71a">
Nov 30 08:09:41 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 08:09:41 user nova-compute[74963]:         </nova:port>
Nov 30 08:09:41 user nova-compute[74963]:       </nova:ports>
Nov 30 08:09:41 user nova-compute[74963]:     </nova:instance>
Nov 30 08:09:41 user nova-compute[74963]:   </metadata>
Nov 30 08:09:41 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:09:41 user nova-compute[74963]:     <system>
Nov 30 08:09:41 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:09:41 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:09:41 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:09:41 user nova-compute[74963]:       <entry name="serial">70392773-3fa7-4fb1-8513-9f0391f9e0e0</entry>
Nov 30 08:09:41 user nova-compute[74963]:       <entry name="uuid">70392773-3fa7-4fb1-8513-9f0391f9e0e0</entry>
Nov 30 08:09:41 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:09:41 user nova-compute[74963]:     </system>
Nov 30 08:09:41 user nova-compute[74963]:   </sysinfo>
Nov 30 08:09:41 user nova-compute[74963]:   <os>
Nov 30 08:09:41 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:09:41 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:09:41 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:09:41 user nova-compute[74963]:   </os>
Nov 30 08:09:41 user nova-compute[74963]:   <features>
Nov 30 08:09:41 user nova-compute[74963]:     <acpi/>
Nov 30 08:09:41 user nova-compute[74963]:     <apic/>
Nov 30 08:09:41 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:09:41 user nova-compute[74963]:   </features>
Nov 30 08:09:41 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:09:41 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:09:41 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:09:41 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:09:41 user nova-compute[74963]:   </clock>
Nov 30 08:09:41 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:09:41 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:09:41 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:09:41 user nova-compute[74963]:   </cpu>
Nov 30 08:09:41 user nova-compute[74963]:   <devices>
Nov 30 08:09:41 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:09:41 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:09:41 user nova-compute[74963]:       <source dev="/dev/sdd"/>
Nov 30 08:09:41 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:09:41 user nova-compute[74963]:       <serial>959c79f1-2657-4e31-9f80-c2c7f120d46f</serial>
Nov 30 08:09:41 user nova-compute[74963]:     </disk>
Nov 30 08:09:41 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:09:41 user nova-compute[74963]:       <mac address="fa:16:3e:68:eb:73"/>
Nov 30 08:09:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:09:41 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:09:41 user nova-compute[74963]:       <target dev="tap203987cf-1c"/>
Nov 30 08:09:41 user nova-compute[74963]:     </interface>
Nov 30 08:09:41 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:09:41 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/console.log" append="off"/>
Nov 30 08:09:41 user nova-compute[74963]:     </serial>
Nov 30 08:09:41 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:09:41 user nova-compute[74963]:     <video>
Nov 30 08:09:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:09:41 user nova-compute[74963]:     </video>
Nov 30 08:09:41 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:09:41 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:09:41 user nova-compute[74963]:     </rng>
Nov 30 08:09:41 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:09:41 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:09:41 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:09:41 user nova-compute[74963]:     </memballoon>
Nov 30 08:09:41 user nova-compute[74963]:   </devices>
Nov 30 08:09:41 user nova-compute[74963]: </domain>
Nov 30 08:09:41 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074003933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074003933',id=12,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-vnr2mkxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:09:06Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=70392773-3fa7-4fb1-8513-9f0391f9e0e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=203987cf-1c90-44b7-9ca1-1eed9597d71a,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203987cf-1c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG os_vif [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=203987cf-1c90-44b7-9ca1-1eed9597d71a,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203987cf-1c') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de4310a5-2b45-5bf8-8388-b3ddda885985', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap203987cf-1c, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap203987cf-1c, col_values=(('qos', UUID('867cd203-890e-4b53-beac-e82e68c42b33')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap203987cf-1c, col_values=(('external_ids', {'iface-id': '203987cf-1c90-44b7-9ca1-1eed9597d71a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:eb:73', 'vm-uuid': '70392773-3fa7-4fb1-8513-9f0391f9e0e0'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:41 user nova-compute[74963]: INFO os_vif [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=203987cf-1c90-44b7-9ca1-1eed9597d71a,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203987cf-1c')
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 1038090240 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No VIF found with MAC fa:16:3e:68:eb:73, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkrRAnxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'ad1369df-f7ce-4c71-a775-e24b45c31650'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:41 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[103bbf84-b8ae-48ac-aa09-2355743ac80a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:09:41 user nova-compute[74963]: No targets found.
Nov 30 08:09:41 user nova-compute[74963]: iSNS:
Nov 30 08:09:41 user nova-compute[74963]: No targets found.
Nov 30 08:09:41 user nova-compute[74963]: STATIC:
Nov 30 08:09:41 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232
Nov 30 08:09:41 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:41 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:41 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650
Nov 30 08:09:41 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:41 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:41 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a
Nov 30 08:09:41 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:41 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:41 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:09:41 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:09:41 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:09:41 user nova-compute[74963]: FIRMWARE:
Nov 30 08:09:41 user nova-compute[74963]: No targets found.
Nov 30 08:09:41 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:09:41 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:09:41 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b89fc6-0c08-4fca-934c-3ca3f6dcad44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e852780e-ea2c-4147-9d5a-7fd05c0ba09e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:42 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:09:42 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:42 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:42 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:09:42 user nova-compute[74963]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 (non-flash)
Nov 30 08:09:42 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62444c77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650'): ({'sdf'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Removing single pathed devices sdf {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfa1f36-06b7-4d62-91ea-03c9efabe08b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1633ba8e-4c75-4d98-a719-14805c300106]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Flushing IO for device /dev/sdf {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[712158f9-b548-4ac8-b538-763156386f14]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13efbe5-8628-43f2-a083-0ab94c14b83a]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3a62b9-f7d9-47f0-b21d-5f212c865f33]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[febf98fc-7c26-47a2-8959-041feec6968e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650, portal: 172.16.0.220,3260]
Nov 30 08:09:42 user nova-compute[74963]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650, portal: 172.16.0.220,3260] successful.
Nov 30 08:09:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1369df-f7ce-4c71-a775-e24b45c31650 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d303d67a-c52b-4ddb-9b7c-86ad8f2ea958]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] <== disconnect_volume: return (360ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDczNgwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '98e1c4f0-b628-435a-bf98-f814fa927873', 'attached_at': '', 'detached_at': '', 'volume_id': '0a3b04f8-6848-4379-a798-0d0dc10a0232', 'serial'} {{(pid=74963) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] swap_volume: removing Cinder connection for volume ad1369df-f7ce-4c71-a775-e24b45c31650 {{(pid=74963) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-9762c518-3955-49d9-b2e6-370e54796a7a req-39a199a7-9b07-454e-83c6-980458bc3c36 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9762c518-3955-49d9-b2e6-370e54796a7a req-39a199a7-9b07-454e-83c6-980458bc3c36 service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9762c518-3955-49d9-b2e6-370e54796a7a req-39a199a7-9b07-454e-83c6-980458bc3c36 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9762c518-3955-49d9-b2e6-370e54796a7a req-39a199a7-9b07-454e-83c6-980458bc3c36 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-9762c518-3955-49d9-b2e6-370e54796a7a req-39a199a7-9b07-454e-83c6-980458bc3c36 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:42 user nova-compute[74963]: WARNING nova.compute.manager [req-9762c518-3955-49d9-b2e6-370e54796a7a req-39a199a7-9b07-454e-83c6-980458bc3c36 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state building and task_state spawning.
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:43 user nova-compute[74963]: INFO nova.compute.manager [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attaching volume 778cf0c1-1e27-41e4-b3aa-36c07d410e16 to /dev/vdb
Nov 30 08:09:43 user nova-compute[74963]: DEBUG os_brick.utils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe2e926-6c56-48a6-a35e-6274b2b39641]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f829b7b5-c9da-4f5f-8843-12aa680db40b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0508c89-07d1-450e-b0f4-40778844421d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc0a35f-1701-4fc2-8850-b060a759a251]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:43 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:09:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabb12b7-91c5-48f6-9f91-5e0325aa4b8c]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG os_brick.utils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating existing volume attachment record: 2024d3af-25b7-4a23-8542-885c82759ed0 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:09:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lazy-loading 'flavor' on Instance uuid 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:44 user nova-compute[74963]: INFO nova.compute.manager [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Attaching volume 23624b43-265b-413f-b417-bbb4b40abbe0 to /dev/vdc
Nov 30 08:09:44 user nova-compute[74963]: DEBUG os_brick.utils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e0912c-acb5-49dd-ab5b-4a3616cf4dc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b0a139-f53c-46cb-b713-585df49800fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf664ac4-7a19-4bd6-b10c-a96c5bed62d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[943b5573-7c70-42c2-8037-d7de050b3681]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:44 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:09:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[06beee3c-02cb-476f-83b4-2ff35c89b49f]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG os_brick.utils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Updating existing volume attachment record: bf8d8c08-8a32-4354-89d3-636fdd952540 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:09:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Instance spawned successfully.
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:09:44 user nova-compute[74963]: INFO nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Took 8.39 seconds to spawn the instance on the hypervisor.
Nov 30 08:09:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:09:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-13cd9b18-633d-48e3-b216-9698dfa7be1d req-e2f83d47-8788-41f7-975b-fa6d4c8ea9ac service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13cd9b18-633d-48e3-b216-9698dfa7be1d req-e2f83d47-8788-41f7-975b-fa6d4c8ea9ac service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13cd9b18-633d-48e3-b216-9698dfa7be1d req-e2f83d47-8788-41f7-975b-fa6d4c8ea9ac service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13cd9b18-633d-48e3-b216-9698dfa7be1d req-e2f83d47-8788-41f7-975b-fa6d4c8ea9ac service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-13cd9b18-633d-48e3-b216-9698dfa7be1d req-e2f83d47-8788-41f7-975b-fa6d4c8ea9ac service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:45 user nova-compute[74963]: WARNING nova.compute.manager [req-13cd9b18-633d-48e3-b216-9698dfa7be1d req-e2f83d47-8788-41f7-975b-fa6d4c8ea9ac service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state building and task_state spawning.
Nov 30 08:09:45 user nova-compute[74963]: INFO nova.compute.manager [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Took 40.18 seconds to build instance.
Nov 30 08:09:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3692b847-d5c5-4cda-aa63-86628e0c302f tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.282s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:46 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] swap_volume: Updating volume ad1369df-f7ce-4c71-a775-e24b45c31650 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WDczNgwv", "auth_password": "gFdAZoDyrXN4Qa", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "0a3b04f8-6848-4379-a798-0d0dc10a0232"}, "status": "reserved", "instance": "98e1c4f0-b628-435a-bf98-f814fa927873", "attached_at": "", "detached_at": "", "volume_id": "0a3b04f8-6848-4379-a798-0d0dc10a0232", "serial": "0a3b04f8-6848-4379-a798-0d0dc10a0232"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0a3b04f8-6848-4379-a798-0d0dc10a0232', 'no_device': None, 'attachment_id': 'bdd84c5d-cf73-4a8e-b889-7d544ea4346a'} {{(pid=74963) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 30 08:09:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3db4dc44-2a63-420a-af9c-ca25b68b29b2 tempest-TestVolumeSwap-1207726235 tempest-TestVolumeSwap-1207726235-project-admin] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 40.332s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "9579e650-53bf-4772-888e-aa95a4108f75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:47 user nova-compute[74963]: INFO nova.compute.manager [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Terminating instance
Nov 30 08:09:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-f9dd93f0-ac10-41ae-be26-208fb36cd9ff req-8a36c268-1b88-4753-9657-a1dfe8e05101 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received event network-vif-unplugged-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f9dd93f0-ac10-41ae-be26-208fb36cd9ff req-8a36c268-1b88-4753-9657-a1dfe8e05101 service nova] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f9dd93f0-ac10-41ae-be26-208fb36cd9ff req-8a36c268-1b88-4753-9657-a1dfe8e05101 service nova] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f9dd93f0-ac10-41ae-be26-208fb36cd9ff req-8a36c268-1b88-4753-9657-a1dfe8e05101 service nova] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-f9dd93f0-ac10-41ae-be26-208fb36cd9ff req-8a36c268-1b88-4753-9657-a1dfe8e05101 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] No waiting events found dispatching network-vif-unplugged-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-f9dd93f0-ac10-41ae-be26-208fb36cd9ff req-8a36c268-1b88-4753-9657-a1dfe8e05101 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received event network-vif-unplugged-c797d1f2-cde0-44bf-8552-2f00b88d549a for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "16fe9479-fdd8-493f-92f9-a59b84af0342" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:47 user nova-compute[74963]: INFO nova.compute.manager [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Terminating instance
Nov 30 08:09:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Instance destroyed successfully.
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lazy-loading 'resources' on Instance uuid 9579e650-53bf-4772-888e-aa95a4108f75 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-723473140',display_name='tempest-VolumesAssistedSnapshotsTest-server-723473140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-723473140',id=7,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFsTyvXtu/UsB8DrK+A7rP5SJ26h/4akhPolxPB5bLWHWZuB2zoFRLdojCee82Bw31AR2vhWBxJY3/ABKqcYRYHCl5LFXVoVLwLr6XM/HtH3+7OczNDfnMozjfNZqiZqw==',key_name='tempest-keypair-977526846',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='add45f088a414c8d8a602f23e061700d',ramdisk_id='',reservation_id='r-4ndicz4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-558289142',owner_user_name='tempest-VolumesAssistedSnapshotsTest-558289142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b12c28a89dc4c5a8148e87d813c9c2d',uuid=9579e650-53bf-4772-888e-aa95a4108f75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Converting VIF {"id": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "address": "fa:16:3e:d5:c5:5e", "network": {"id": "b529ac7d-1104-4486-92f7-26e249a742d5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-28017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add45f088a414c8d8a602f23e061700d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc797d1f2-cd", "ovs_interfaceid": "c797d1f2-cde0-44bf-8552-2f00b88d549a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:c5:5e,bridge_name='br-int',has_traffic_filtering=True,id=c797d1f2-cde0-44bf-8552-2f00b88d549a,network=Network(b529ac7d-1104-4486-92f7-26e249a742d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc797d1f2-cd') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG os_vif [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:c5:5e,bridge_name='br-int',has_traffic_filtering=True,id=c797d1f2-cde0-44bf-8552-2f00b88d549a,network=Network(b529ac7d-1104-4486-92f7-26e249a742d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc797d1f2-cd') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.compute.manager [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Detaching volume 0a3b04f8-6848-4379-a798-0d0dc10a0232
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc797d1f2-cd, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3427fcd7-8021-4f49-96ae-d8d9c9f725f9) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: INFO os_vif [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:c5:5e,bridge_name='br-int',has_traffic_filtering=True,id=c797d1f2-cde0-44bf-8552-2f00b88d549a,network=Network(b529ac7d-1104-4486-92f7-26e249a742d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc797d1f2-cd')
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Deleting instance files /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75_del
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Deletion of /opt/stack/data/nova/instances/9579e650-53bf-4772-888e-aa95a4108f75_del complete
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.compute.manager [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 30 08:09:48 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.virt.block_device [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Attempting to driver detach volume 0a3b04f8-6848-4379-a798-0d0dc10a0232 from mountpoint /dev/vdb
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Attempting to detach device vdb from instance 98e1c4f0-b628-435a-bf98-f814fa927873 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:09:48 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:09:48 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:09:48 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:09:48 user nova-compute[74963]:   <serial>0a3b04f8-6848-4379-a798-0d0dc10a0232</serial>
Nov 30 08:09:48 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:09:48 user nova-compute[74963]: </disk>
Nov 30 08:09:48 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Successfully detached device vdb from instance 98e1c4f0-b628-435a-bf98-f814fa927873 from the persistent domain config.
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98e1c4f0-b628-435a-bf98-f814fa927873 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:09:48 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:09:48 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:09:48 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:09:48 user nova-compute[74963]:   <serial>0a3b04f8-6848-4379-a798-0d0dc10a0232</serial>
Nov 30 08:09:48 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:09:48 user nova-compute[74963]: </disk>
Nov 30 08:09:48 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98e1c4f0-b628-435a-bf98-f814fa927873 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Instance destroyed successfully.
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lazy-loading 'resources' on Instance uuid 16fe9479-fdd8-493f-92f9-a59b84af0342 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-465738661',display_name='tempest-ServersNegativeTestJSON-server-465738661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-465738661',id=11,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12e5b724c4d64e9f9900b7bad1c2a00f',ramdisk_id='',reservation_id='r-8s8q7vw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1755407575',owner_user_name='tempest-ServersNegativeTestJSON-1755407575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:08:05Z,user_data=None,user_id='63de4ab983be439488dc30077810b5f0',uuid=16fe9479-fdd8-493f-92f9-a59b84af0342,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converting VIF {"id": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "address": "fa:16:3e:77:fd:bd", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84734d5f-69", "ovs_interfaceid": "84734d5f-69a9-4621-82ec-c0c1e414c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:fd:bd,bridge_name='br-int',has_traffic_filtering=True,id=84734d5f-69a9-4621-82ec-c0c1e414c55a,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84734d5f-69') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG os_vif [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:fd:bd,bridge_name='br-int',has_traffic_filtering=True,id=84734d5f-69a9-4621-82ec-c0c1e414c55a,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84734d5f-69') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84734d5f-69, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2b882d8-a236-42ea-97e2-134b8b920c20) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:48 user nova-compute[74963]: INFO os_vif [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:fd:bd,bridge_name='br-int',has_traffic_filtering=True,id=84734d5f-69a9-4621-82ec-c0c1e414c55a,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84734d5f-69')
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Deleting instance files /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342_del
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Deletion of /opt/stack/data/nova/instances/16fe9479-fdd8-493f-92f9-a59b84af0342_del complete
Nov 30 08:09:48 user nova-compute[74963]: INFO nova.compute.manager [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 30 08:09:48 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:09:48 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-3490d6d7-e221-470e-b330-efa3aa5ad765 req-5af71c67-9383-4a8b-bbf0-cadfd49171d7 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received event network-vif-deleted-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:49 user nova-compute[74963]: INFO nova.compute.manager [req-3490d6d7-e221-470e-b330-efa3aa5ad765 req-5af71c67-9383-4a8b-bbf0-cadfd49171d7 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Neutron deleted interface c797d1f2-cde0-44bf-8552-2f00b88d549a; detaching it from the instance and deleting it from the info cache
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.network.neutron [req-3490d6d7-e221-470e-b330-efa3aa5ad765 req-5af71c67-9383-4a8b-bbf0-cadfd49171d7 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:49 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Took 1.06 seconds to deallocate network for instance.
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-3490d6d7-e221-470e-b330-efa3aa5ad765 req-5af71c67-9383-4a8b-bbf0-cadfd49171d7 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Detach interface failed, port_id=c797d1f2-cde0-44bf-8552-2f00b88d549a, reason: Instance 9579e650-53bf-4772-888e-aa95a4108f75 could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:09:49 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Took 0.77 seconds to deallocate network for instance.
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received event network-vif-plugged-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] Acquiring lock "9579e650-53bf-4772-888e-aa95a4108f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] Lock "9579e650-53bf-4772-888e-aa95a4108f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] No waiting events found dispatching network-vif-plugged-c797d1f2-cde0-44bf-8552-2f00b88d549a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:49 user nova-compute[74963]: WARNING nova.compute.manager [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] [instance: 9579e650-53bf-4772-888e-aa95a4108f75] Received unexpected event network-vif-plugged-c797d1f2-cde0-44bf-8552-2f00b88d549a for instance with vm_state deleted and task_state None.
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received event network-vif-unplugged-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] Acquiring lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] No waiting events found dispatching network-vif-unplugged-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received event network-vif-unplugged-84734d5f-69a9-4621-82ec-c0c1e414c55a for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received event network-vif-plugged-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] Acquiring lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] No waiting events found dispatching network-vif-plugged-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:49 user nova-compute[74963]: WARNING nova.compute.manager [req-c56700b9-5754-4538-8047-45bd18b8517c req-87a69a65-cf1d-4710-b4ef-6f82a1ac5256 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received unexpected event network-vif-plugged-84734d5f-69a9-4621-82ec-c0c1e414c55a for instance with vm_state active and task_state deleting.
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:49 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Deleted allocations for instance 9579e650-53bf-4772-888e-aa95a4108f75
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7574d1e7-15f4-4d51-b72e-4e4ec0e6c460 tempest-VolumesAssistedSnapshotsTest-558289142 tempest-VolumesAssistedSnapshotsTest-558289142-project-member] Lock "9579e650-53bf-4772-888e-aa95a4108f75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.607s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:09:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:50 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Deleted allocations for instance 16fe9479-fdd8-493f-92f9-a59b84af0342
Nov 30 08:09:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-10ba7c0d-70fe-4628-a2ea-6eaf958bb895 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "16fe9479-fdd8-493f-92f9-a59b84af0342" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.515s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-51696158-b57a-424b-b86a-5ab9100125ee req-ab536488-2fd8-4191-8e1f-f7116093a3c1 service nova] [instance: 16fe9479-fdd8-493f-92f9-a59b84af0342] Received event network-vif-deleted-84734d5f-69a9-4621-82ec-c0c1e414c55a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:51 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lazy-loading 'flavor' on Instance uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:51 user nova-compute[74963]: INFO nova.compute.manager [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Attaching volume 0705d8a6-7d88-49a3-b0c9-341d67e1c036 to /dev/vdb
Nov 30 08:09:52 user nova-compute[74963]: DEBUG os_brick.utils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce043056-ac73-4ab3-b10b-38c79d25e546]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7b357-0ac4-408e-802a-a953bba2d271]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[422fe99e-202b-4b42-93bd-067f258c5ae2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60e943f-9031-482c-93a5-55b703d9e854]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:09:52 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:09:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece8c69-6ff3-4006-8a04-6946fa92aa3e]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG os_brick.utils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:52 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating existing volume attachment record: 90563bb7-a8fe-420c-8b06-78b5026e3391 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkIwiMtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:09:53 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:53 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:09:53 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f46078-05eb-405f-a722-cbc2e9c2ba33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:09:53 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e481293-dc89-43b0-8c7e-eb7264b8828a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16] added
Nov 30 08:09:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31167b3-af45-410c-8f24-d7fd4236c22c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c019689-1dcd-446a-b214-51539940a17f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkIwiMtC {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkIwiMtC" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df77b79-6dcc-4af0-83b7-ce245b39636c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkIwiMtC'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4672008b-53a2-4b3b-9d05-ee85ad2927f0]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d19d97-70ae-4d19-88c2-79b27d77c7c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9281f7ae-8770-4788-bfc2-af30806e84eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16, portal: 172.16.0.220,3260]
Nov 30 08:09:53 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16, portal: 172.16.0.220,3260] successful.
Nov 30 08:09:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15aec93-7588-4448-a1ee-51f82e21c762]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[67353631-a0b9-4785-a70b-65a927f65e3d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:09:53 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:09:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[23417b07-c5e7-412e-b62b-8072347a3282]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:09:53 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: None {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkIwiMtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23735663061613166', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735663061613166', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:09:54 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:09:54 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:09:54 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:09:54 user nova-compute[74963]:   <serial>778cf0c1-1e27-41e4-b3aa-36c07d410e16</serial>
Nov 30 08:09:54 user nova-compute[74963]: </disk>
Nov 30 08:09:54 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:54 user nova-compute[74963]: INFO nova.compute.manager [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Terminating instance
Nov 30 08:09:54 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-41dcda2c-dac1-4a0e-8b7c-ad2bbb29622e req-87f51c08-89eb-41f7-82e6-8ddedfb80ffd service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-unplugged-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41dcda2c-dac1-4a0e-8b7c-ad2bbb29622e req-87f51c08-89eb-41f7-82e6-8ddedfb80ffd service nova] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41dcda2c-dac1-4a0e-8b7c-ad2bbb29622e req-87f51c08-89eb-41f7-82e6-8ddedfb80ffd service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41dcda2c-dac1-4a0e-8b7c-ad2bbb29622e req-87f51c08-89eb-41f7-82e6-8ddedfb80ffd service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-41dcda2c-dac1-4a0e-8b7c-ad2bbb29622e req-87f51c08-89eb-41f7-82e6-8ddedfb80ffd service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] No waiting events found dispatching network-vif-unplugged-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-41dcda2c-dac1-4a0e-8b7c-ad2bbb29622e req-87f51c08-89eb-41f7-82e6-8ddedfb80ffd service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-unplugged-662f4120-2ba1-466d-81b6-212565a16a9d for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No VIF found with MAC fa:16:3e:e2:e7:00, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e4935378-b9e1-45df-bd08-97019b410787 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.291s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:55 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Instance destroyed successfully.
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lazy-loading 'resources' on Instance uuid 6fec797d-1752-464f-8e89-3f1b21cda724 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560530600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560530600',id=8,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIIMB50S1UrUdAIYurXG++T+DeKVYav11Y2BaKQ3ngEyQM/V5KCBuxUZ9zN/R/zlOKWamLw2XB6+Vkj/xUqSM+aCM6/ySzgbLvOn3nCdOOw3/wxulg0yoXKpuiKCLYag==',key_name='tempest-keypair-1537203754',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069409ef36774791b13e4a3eec8d6648',ramdisk_id='',reservation_id='r-zjozxt7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-834159471',owner_user_name='tempest-TaggedAttachmentsTest-834159471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='644095bd2e894f0db86ed3a7d1a06c7a',uuid=6fec797d-1752-464f-8e89-3f1b21cda724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converting VIF {"id": "662f4120-2ba1-466d-81b6-212565a16a9d", "address": "fa:16:3e:15:71:ec", "network": {"id": "4a32cfd7-b44e-4423-a4cf-201ebd2800be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649215734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069409ef36774791b13e4a3eec8d6648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662f4120-2b", "ovs_interfaceid": "662f4120-2ba1-466d-81b6-212565a16a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:71:ec,bridge_name='br-int',has_traffic_filtering=True,id=662f4120-2ba1-466d-81b6-212565a16a9d,network=Network(4a32cfd7-b44e-4423-a4cf-201ebd2800be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662f4120-2b') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG os_vif [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:71:ec,bridge_name='br-int',has_traffic_filtering=True,id=662f4120-2ba1-466d-81b6-212565a16a9d,network=Network(4a32cfd7-b44e-4423-a4cf-201ebd2800be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662f4120-2b') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap662f4120-2b, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f52f802-99a7-4712-9ced-dec54537d4c0) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:09:55 user nova-compute[74963]: INFO os_vif [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:71:ec,bridge_name='br-int',has_traffic_filtering=True,id=662f4120-2ba1-466d-81b6-212565a16a9d,network=Network(4a32cfd7-b44e-4423-a4cf-201ebd2800be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662f4120-2b')
Nov 30 08:09:55 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Deleting instance files /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724_del
Nov 30 08:09:55 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Deletion of /opt/stack/data/nova/instances/6fec797d-1752-464f-8e89-3f1b21cda724_del complete
Nov 30 08:09:55 user nova-compute[74963]: INFO nova.compute.manager [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 30 08:09:55 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:09:55 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:09:56 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:09:56 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Took 0.75 seconds to deallocate network for instance.
Nov 30 08:09:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-1f8438ed-5dc2-499e-b807-766298eb29fa req-de6ee7e7-9491-47dd-94ae-17a4e88aac47 service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-deleted-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:56 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:09:56 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:09:57 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Deleted allocations for instance 6fec797d-1752-464f-8e89-3f1b21cda724
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ee379a00-f75f-4357-8d55-9553785077c4 tempest-TaggedAttachmentsTest-834159471 tempest-TaggedAttachmentsTest-834159471-project-member] Lock "6fec797d-1752-464f-8e89-3f1b21cda724" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-3bb277f6-10dd-4a48-9708-c55915562523 req-24362ef0-18a3-45f4-b4c4-6a0ef5be74ee service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received event network-vif-plugged-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3bb277f6-10dd-4a48-9708-c55915562523 req-24362ef0-18a3-45f4-b4c4-6a0ef5be74ee service nova] Acquiring lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3bb277f6-10dd-4a48-9708-c55915562523 req-24362ef0-18a3-45f4-b4c4-6a0ef5be74ee service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3bb277f6-10dd-4a48-9708-c55915562523 req-24362ef0-18a3-45f4-b4c4-6a0ef5be74ee service nova] Lock "6fec797d-1752-464f-8e89-3f1b21cda724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-3bb277f6-10dd-4a48-9708-c55915562523 req-24362ef0-18a3-45f4-b4c4-6a0ef5be74ee service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] No waiting events found dispatching network-vif-plugged-662f4120-2ba1-466d-81b6-212565a16a9d {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:09:57 user nova-compute[74963]: WARNING nova.compute.manager [req-3bb277f6-10dd-4a48-9708-c55915562523 req-24362ef0-18a3-45f4-b4c4-6a0ef5be74ee service nova] [instance: 6fec797d-1752-464f-8e89-3f1b21cda724] Received unexpected event network-vif-plugged-662f4120-2ba1-466d-81b6-212565a16a9d for instance with vm_state deleted and task_state None.
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:09:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:09:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:09:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:00 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:10:00 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8140MB free_disk=25.576457977294922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 3551893b-4a59-4e6a-a961-8ea6d671632e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 25afcf51-de30-4a53-bb6b-3e7037f5e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 98e1c4f0-b628-435a-bf98-f814fa927873 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 67d99f85-78de-4702-aa55-758173230187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:01 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:10:01 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:10:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:10:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:01 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:10:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Updating instance_info_cache with network_info: [{"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-98e1c4f0-b628-435a-bf98-f814fa927873" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:10:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:10:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:10:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:10:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:10:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:10:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:10:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Acquiring lock "1599d49e-fd6a-405a-9770-1a89cdc387cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Lock "1599d49e-fd6a-405a-9770-1a89cdc387cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:10:06 user nova-compute[74963]: INFO nova.compute.claims [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Claim successful on node user
Nov 30 08:10:06 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:10:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:10:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:10:06 user nova-compute[74963]: INFO nova.virt.block_device [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Booting with volume c7f98678-6588-4993-bd49-639aa42a0d81 at /dev/vda
Nov 30 08:10:06 user nova-compute[74963]: DEBUG os_brick.utils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG nova.policy [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d1b3171253a417ea5fd59e5005d841e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccae4f8cabf46389a90e7f1560ab091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[97809077-40a8-42b9-83a9-5874b9cef9d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07259ea-f34b-4d66-b6f3-435a55c07c2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a11d60-04fd-4947-aa6b-eaba7e1b33d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[305c6164-652a-4a0b-8cbd-138be5893398]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:10:06 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:10:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf389caf-43c2-4549-8eee-e2c50c99cd9a]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG os_brick.utils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:10:06 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating existing volume attachment record: 0bc3e7ea-dced-4d14-b514-7af25d8dbaaa {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:10:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully created port: 67c60162-0d3e-44c3-92fd-6331f799d72d {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:10:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully created port: 9ab29c93-636d-40ef-b98c-8af8b9db551d {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully created port: fc3f5cd1-044e-4b02-b62b-0d4d80b4a500 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:10:08 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98e1c4f0-b628-435a-bf98-f814fa927873 is timed out.
Nov 30 08:10:08 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Successfully detached device vdb from instance 98e1c4f0-b628-435a-bf98-f814fa927873 from the live domain config.
Nov 30 08:10:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDczNgwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '0a3b04f8-6848-4379-a798-0d0dc10a0232'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:10:08 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bdd2be-8b1c-4049-b910-728fa55b4c94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:10:08 user nova-compute[74963]: No targets found.
Nov 30 08:10:08 user nova-compute[74963]: iSNS:
Nov 30 08:10:08 user nova-compute[74963]: No targets found.
Nov 30 08:10:08 user nova-compute[74963]: STATIC:
Nov 30 08:10:08 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232
Nov 30 08:10:08 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:08 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:08 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16
Nov 30 08:10:08 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:08 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:08 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a
Nov 30 08:10:08 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:08 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:08 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:10:08 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:08 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:08 user nova-compute[74963]: FIRMWARE:
Nov 30 08:10:08 user nova-compute[74963]: No targets found.
Nov 30 08:10:08 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:10:08 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:10:08 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d18ab72-85b2-4564-a9ce-a2de85a3a6e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9edabd1-586d-4bd3-8c79-c4a3ad77abdb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:08 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:08 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:08 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:10:08 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:08 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:08 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:08 user nova-compute[74963]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 (non-flash)
Nov 30 08:10:08 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62444a3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb6d0db-f74c-40d5-a171-249e496f5ef5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7168715-10ca-4d32-8baf-eee077dc71b0]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[40541ca4-cff5-4292-b814-42add7a23a25]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bba479-03b7-40bc-a9a1-f14a0c061bf8]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7542c266-f625-41e6-ae70-44d723cd7483]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba7baf6-d26d-4dc9-84a5-154dc98a51df]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260]
Nov 30 08:10:09 user nova-compute[74963]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232, portal: 172.16.0.220,3260] successful.
Nov 30 08:10:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3b04f8-6848-4379-a798-0d0dc10a0232 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c93c283-e204-4d1c-89ba-b5659f9ab989]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] <== disconnect_volume: return (342ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully created port: 26682746-dfc0-42f2-8c4c-a4d35c39f627 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:10:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully created port: 47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:10:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully updated port: 67c60162-0d3e-44c3-92fd-6331f799d72d {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:10:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-ce6b9ac3-b5ea-4c84-bf57-7f1e75f67cc7 req-2d0b16d7-5c31-4e70-bbdb-8e2dbc960edb service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Received event network-changed-67c60162-0d3e-44c3-92fd-6331f799d72d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-ce6b9ac3-b5ea-4c84-bf57-7f1e75f67cc7 req-2d0b16d7-5c31-4e70-bbdb-8e2dbc960edb service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing instance network info cache due to event network-changed-67c60162-0d3e-44c3-92fd-6331f799d72d. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:10:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ce6b9ac3-b5ea-4c84-bf57-7f1e75f67cc7 req-2d0b16d7-5c31-4e70-bbdb-8e2dbc960edb service nova] Acquiring lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ce6b9ac3-b5ea-4c84-bf57-7f1e75f67cc7 req-2d0b16d7-5c31-4e70-bbdb-8e2dbc960edb service nova] Acquired lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:10 user nova-compute[74963]: DEBUG nova.network.neutron [req-ce6b9ac3-b5ea-4c84-bf57-7f1e75f67cc7 req-2d0b16d7-5c31-4e70-bbdb-8e2dbc960edb service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing network info cache for port 67c60162-0d3e-44c3-92fd-6331f799d72d {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:10:10 user nova-compute[74963]: DEBUG nova.network.neutron [req-ce6b9ac3-b5ea-4c84-bf57-7f1e75f67cc7 req-2d0b16d7-5c31-4e70-bbdb-8e2dbc960edb service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:10:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-ce6b9ac3-b5ea-4c84-bf57-7f1e75f67cc7 req-2d0b16d7-5c31-4e70-bbdb-8e2dbc960edb service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ce6b9ac3-b5ea-4c84-bf57-7f1e75f67cc7 req-2d0b16d7-5c31-4e70-bbdb-8e2dbc960edb service nova] Releasing lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvaebyBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:10:11 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:11 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:11 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1b39b7-f741-43cd-9c8a-c47272440292]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:10:11 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:10:11 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56f4614-5e61-48d9-92c1-618322b008a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0] added
Nov 30 08:10:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully updated port: 41ed3217-9db5-4ce0-8d39-bd262fd517ca {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46aba39-ca69-4843-967f-e3eb778c9df2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ace08a-fe11-4bd9-a2aa-cefd84f33072]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvaebyBk {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvaebyBk" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[85151cc9-e5f4-448a-a67e-14f3b24c3ab2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvaebyBk'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa74faa-b7ce-4487-90e3-2f68acf8bf75]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ab915-43be-4beb-8091-12737852c6ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ee4974-fdaa-40ae-bdb7-bde6c686d372]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0, portal: 172.16.0.220,3260]
Nov 30 08:10:11 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0, portal: 172.16.0.220,3260] successful.
Nov 30 08:10:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2f81c-312f-4963-a97b-20e35c6b9aef]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ce4b3-fe89-4ce4-bb4b-dc5870f1d857]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:11 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a558a5f-56cf-4666-a5ff-e338c670422a]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:10:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvaebyBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully updated port: 51ad193a-0a2f-4dcc-8d08-323afb42d2cf {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG nova.objects.instance [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lazy-loading 'flavor' on Instance uuid 98e1c4f0-b628-435a-bf98-f814fa927873 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-49b28c8b-d5d5-4ff4-b1da-36b9552b08a0 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.609s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Received event network-changed-41ed3217-9db5-4ce0-8d39-bd262fd517ca {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing instance network info cache due to event network-changed-41ed3217-9db5-4ce0-8d39-bd262fd517ca. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] Acquiring lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] Acquired lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing network info cache for port 41ed3217-9db5-4ce0-8d39-bd262fd517ca {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23862303763656330', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862303763656330', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.volume.cinder [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Update attachment failed for attachment 0bc3e7ea-dced-4d14-b514-7af25d8dbaaa. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6143a5de-bf69-4b5f-ae4d-5d2cb0f3c000) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6143a5de-bf69-4b5f-ae4d-5d2cb0f3c000)
Nov 30 08:10:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.338s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:12 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:12 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:10:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lazy-loading 'flavor' on Instance uuid 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6143a5de-bf69-4b5f-ae4d-5d2cb0f3c000)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Traceback (most recent call last):
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     driver_block_device.attach_block_devices(
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     _log_and_attach(device)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     bdm.attach(*attach_args, **attach_kwargs)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     ret_val = method(obj, context, *args, **kwargs)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     self._do_attach(context, instance, volume, volume_api,
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     self._volume_attach(context, volume, connector, instance,
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     connection_info = volume_api.attachment_update(
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     res = method(self, ctx, *args, **kwargs)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     with excutils.save_and_reraise_exception():
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     self.force_reraise()
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     raise self.value
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     context, '3.44', skip_version_check=True).attachments.update(
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     return method.func(obj, *args, **kwargs)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     resp = self._update('/attachments/%s' % id, body)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     return self._cs_request(url, 'PUT', **kwargs)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     return self.request(url, method, **kwargs)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc]     raise exceptions.from_response(resp, body)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6143a5de-bf69-4b5f-ae4d-5d2cb0f3c000)
Nov 30 08:10:12 user nova-compute[74963]: ERROR nova.compute.manager [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] 
Nov 30 08:10:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9a0d9e-7921-4ac0-b622-117963ce1654]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:10:12 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d8ccb0-f197-4e88-9323-22066dc422f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036] added
Nov 30 08:10:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:10:13 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:10:13 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:10:13 user nova-compute[74963]:   <target dev="vdc" bus="virtio"/>
Nov 30 08:10:13 user nova-compute[74963]:   <serial>23624b43-265b-413f-b417-bbb4b40abbe0</serial>
Nov 30 08:10:13 user nova-compute[74963]: </disk>
Nov 30 08:10:13 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[397235e1-2bce-4b1e-b4d1-634729ad535b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf13a58-c1d2-44a3-95a0-57da593eb0fc]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzlsTFwc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzlsTFwc" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c8321-500b-4dca-ab4f-ab33f92f8db8]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yzlsTFwc'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb02e93-7b11-4b6b-92af-31e3832e36ee]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d9e819-27a3-4653-ac51-fb78548cc393]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] Releasing lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Received event network-changed-51ad193a-0a2f-4dcc-8d08-323afb42d2cf {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing instance network info cache due to event network-changed-51ad193a-0a2f-4dcc-8d08-323afb42d2cf. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] Acquiring lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] Acquired lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing network info cache for port 51ad193a-0a2f-4dcc-8d08-323afb42d2cf {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd8f049-708a-4811-829d-4c4d73863b19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]
Nov 30 08:10:13 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.
Nov 30 08:10:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2751a94-b8fb-40fd-ac9b-3d7cb7db3993]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ee5b69-d40e-4b05-9820-99b6567fc444]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96b7b78-fbb8-419e-af78-ad0e757d8e57]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] No VIF found with MAC fa:16:3e:3b:ec:0f, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d68709af-31ee-4cbf-b774-1430c9854127 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.305s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully updated port: 9ab29c93-636d-40ef-b98c-8af8b9db551d {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:10:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-00cc9297-d628-4b4e-9b49-4a6e59ef549b req-0c4e5c96-69d7-4ef2-ae85-16cce1d6f260 service nova] Releasing lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:14 user nova-compute[74963]: INFO nova.compute.manager [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Detaching volume 23624b43-265b-413f-b417-bbb4b40abbe0
Nov 30 08:10:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] <== connect_volume: return (2723ms) {'type': 'block', 'scsi_wwn': '23337653934356136', 'path': '/dev/sdf'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337653934356136', 'path': '/dev/sdf'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lazy-loading 'flavor' on Instance uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:10:14 user nova-compute[74963]: INFO nova.virt.block_device [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Attempting to driver detach volume 23624b43-265b-413f-b417-bbb4b40abbe0 from mountpoint /dev/vdc
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:10:14 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:10:14 user nova-compute[74963]:   <source dev="/dev/sdf"/>
Nov 30 08:10:14 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:10:14 user nova-compute[74963]:   <serial>0705d8a6-7d88-49a3-b0c9-341d67e1c036</serial>
Nov 30 08:10:14 user nova-compute[74963]: </disk>
Nov 30 08:10:14 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Attempting to detach device vdc from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:10:14 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:10:14 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:10:14 user nova-compute[74963]:   <target dev="vdc" bus="virtio"/>
Nov 30 08:10:14 user nova-compute[74963]:   <serial>23624b43-265b-413f-b417-bbb4b40abbe0</serial>
Nov 30 08:10:14 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 08:10:14 user nova-compute[74963]: </disk>
Nov 30 08:10:14 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:10:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Successfully detached device vdc from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c from the persistent domain config.
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:10:14 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:10:14 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:10:14 user nova-compute[74963]:   <target dev="vdc" bus="virtio"/>
Nov 30 08:10:14 user nova-compute[74963]:   <serial>23624b43-265b-413f-b417-bbb4b40abbe0</serial>
Nov 30 08:10:14 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 08:10:14 user nova-compute[74963]: </disk>
Nov 30 08:10:14 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully updated port: fc3f5cd1-044e-4b02-b62b-0d4d80b4a500 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Received event network-changed-9ab29c93-636d-40ef-b98c-8af8b9db551d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing instance network info cache due to event network-changed-9ab29c93-636d-40ef-b98c-8af8b9db551d. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] Acquiring lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] Acquired lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.network.neutron [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing network info cache for port 9ab29c93-636d-40ef-b98c-8af8b9db551d {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] No VIF found with MAC fa:16:3e:35:ea:ab, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:10:14 user nova-compute[74963]: DEBUG nova.network.neutron [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2c58e980-78d8-45fe-a9ad-fedf3cf4ecb0 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.150s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] Releasing lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Received event network-changed-fc3f5cd1-044e-4b02-b62b-0d4d80b4a500 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing instance network info cache due to event network-changed-fc3f5cd1-044e-4b02-b62b-0d4d80b4a500. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] Acquiring lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] Acquired lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing network info cache for port fc3f5cd1-044e-4b02-b62b-0d4d80b4a500 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully updated port: 26682746-dfc0-42f2-8c4c-a4d35c39f627 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-75e50340-ca90-4b43-8adc-788c5ae2c75c req-f92fd416-f9be-4561-b999-7e2024fd926f service nova] Releasing lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:16 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Successfully updated port: 47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:10:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Acquiring lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Acquired lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:16 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:10:16 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:10:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Received event network-changed-26682746-dfc0-42f2-8c4c-a4d35c39f627 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing instance network info cache due to event network-changed-26682746-dfc0-42f2-8c4c-a4d35c39f627. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:10:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] Acquiring lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:17 user nova-compute[74963]: INFO nova.compute.manager [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Detaching volume 778cf0c1-1e27-41e4-b3aa-36c07d410e16
Nov 30 08:10:17 user nova-compute[74963]: INFO nova.virt.block_device [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attempting to driver detach volume 778cf0c1-1e27-41e4-b3aa-36c07d410e16 from mountpoint /dev/vdb
Nov 30 08:10:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Attempting to detach device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:10:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:10:17 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:10:17 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:10:17 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:10:17 user nova-compute[74963]:   <serial>778cf0c1-1e27-41e4-b3aa-36c07d410e16</serial>
Nov 30 08:10:17 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:10:17 user nova-compute[74963]: </disk>
Nov 30 08:10:17 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:10:17 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully detached device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the persistent domain config.
Nov 30 08:10:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67d99f85-78de-4702-aa55-758173230187 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:10:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:10:17 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:10:17 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:10:17 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:10:17 user nova-compute[74963]:   <serial>778cf0c1-1e27-41e4-b3aa-36c07d410e16</serial>
Nov 30 08:10:17 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:10:17 user nova-compute[74963]: </disk>
Nov 30 08:10:17 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:10:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Stashing vm_state: active {{(pid=74963) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 30 08:10:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:10:17 user nova-compute[74963]: INFO nova.compute.claims [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Claim successful on node user
Nov 30 08:10:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:17 user nova-compute[74963]: INFO nova.compute.resource_tracker [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating resource usage from migration 8bff60fd-3b68-4fc5-916e-ef97635a0749
Nov 30 08:10:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.417s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:18 user nova-compute[74963]: INFO nova.compute.manager [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Migrating
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:18 user nova-compute[74963]: INFO nova.compute.rpcapi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquired lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG nova.network.neutron [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating instance_info_cache with network_info: [{"id": "67c60162-0d3e-44c3-92fd-6331f799d72d", "address": "fa:16:3e:37:65:30", "network": {"id": "99b1450d-f62f-4706-b397-1b4a3d7b8697", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-363608409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c60162-0d", "ovs_interfaceid": "67c60162-0d3e-44c3-92fd-6331f799d72d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "address": "fa:16:3e:62:de:7e", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ed3217-9d", "ovs_interfaceid": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "address": "fa:16:3e:ac:43:72", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ad193a-0a", "ovs_interfaceid": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "address": "fa:16:3e:05:22:29", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab29c93-63", "ovs_interfaceid": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "address": "fa:16:3e:87:df:de", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f5cd1-04", "ovs_interfaceid": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "address": "fa:16:3e:bc:52:4b", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26682746-df", "ovs_interfaceid": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "address": "fa:16:3e:28:f0:52", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f019e2-4e", "ovs_interfaceid": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Releasing lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Instance network_info: |[{"id": "67c60162-0d3e-44c3-92fd-6331f799d72d", "address": "fa:16:3e:37:65:30", "network": {"id": "99b1450d-f62f-4706-b397-1b4a3d7b8697", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-363608409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c60162-0d", "ovs_interfaceid": "67c60162-0d3e-44c3-92fd-6331f799d72d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "address": "fa:16:3e:62:de:7e", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ed3217-9d", "ovs_interfaceid": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "address": "fa:16:3e:ac:43:72", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ad193a-0a", "ovs_interfaceid": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "address": "fa:16:3e:05:22:29", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab29c93-63", "ovs_interfaceid": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "address": "fa:16:3e:87:df:de", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f5cd1-04", "ovs_interfaceid": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "address": "fa:16:3e:bc:52:4b", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26682746-df", "ovs_interfaceid": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "address": "fa:16:3e:28:f0:52", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f019e2-4e", "ovs_interfaceid": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] Acquired lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG nova.network.neutron [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing network info cache for port 26682746-dfc0-42f2-8c4c-a4d35c39f627 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG nova.compute.claims [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Aborting claim: <nova.compute.claims.Claim object at 0x7f62447de1d0> {{(pid=74963) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG nova.network.neutron [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Releasing lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Starting migrate_disk_and_power_off {{(pid=74963) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.477s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Build of instance 1599d49e-fd6a-405a-9770-1a89cdc387cc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6143a5de-bf69-4b5f-ae4d-5d2cb0f3c000) {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.utils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Build of instance 1599d49e-fd6a-405a-9770-1a89cdc387cc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74963) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 30 08:10:19 user nova-compute[74963]: ERROR nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Build of instance 1599d49e-fd6a-405a-9770-1a89cdc387cc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6143a5de-bf69-4b5f-ae4d-5d2cb0f3c000): nova.exception.BuildAbortException: Build of instance 1599d49e-fd6a-405a-9770-1a89cdc387cc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6143a5de-bf69-4b5f-ae4d-5d2cb0f3c000)
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Unplugging VIFs for instance {{(pid=74963) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-966211982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-966211982',id=13,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe/VnaSC4rhdvU8SqZHU7RgJU3M8lwMzvrQ2Gz7R1+64LQdlGLO2XbeZFZJsqiFn0s867nJ5kuFNJ7qfZ9He0S6rElnOysUzLLkc/sFUdNWKlFzc1Ir8QgZjVETUa+sQw==',key_name='tempest-keypair-750191969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ccae4f8cabf46389a90e7f1560ab091',ramdisk_id='',reservation_id='r-3v58ijrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1080438680',owner_user_name='tempest-TaggedBootDevicesTest_v242-1080438680-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1b3171253a417ea5fd59e5005d841e',uuid=1599d49e-fd6a-405a-9770-1a89cdc387cc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67c60162-0d3e-44c3-92fd-6331f799d72d", "address": "fa:16:3e:37:65:30", "network": {"id": "99b1450d-f62f-4706-b397-1b4a3d7b8697", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-363608409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c60162-0d", "ovs_interfaceid": "67c60162-0d3e-44c3-92fd-6331f799d72d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converting VIF {"id": "67c60162-0d3e-44c3-92fd-6331f799d72d", "address": "fa:16:3e:37:65:30", "network": {"id": "99b1450d-f62f-4706-b397-1b4a3d7b8697", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-363608409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c60162-0d", "ovs_interfaceid": "67c60162-0d3e-44c3-92fd-6331f799d72d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:65:30,bridge_name='br-int',has_traffic_filtering=True,id=67c60162-0d3e-44c3-92fd-6331f799d72d,network=Network(99b1450d-f62f-4706-b397-1b4a3d7b8697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c60162-0d') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:65:30,bridge_name='br-int',has_traffic_filtering=True,id=67c60162-0d3e-44c3-92fd-6331f799d72d,network=Network(99b1450d-f62f-4706-b397-1b4a3d7b8697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c60162-0d') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67c60162-0d, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:10:19 user nova-compute[74963]: INFO os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:65:30,bridge_name='br-int',has_traffic_filtering=True,id=67c60162-0d3e-44c3-92fd-6331f799d72d,network=Network(99b1450d-f62f-4706-b397-1b4a3d7b8697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c60162-0d')
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-966211982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-966211982',id=13,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe/VnaSC4rhdvU8SqZHU7RgJU3M8lwMzvrQ2Gz7R1+64LQdlGLO2XbeZFZJsqiFn0s867nJ5kuFNJ7qfZ9He0S6rElnOysUzLLkc/sFUdNWKlFzc1Ir8QgZjVETUa+sQw==',key_name='tempest-keypair-750191969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ccae4f8cabf46389a90e7f1560ab091',ramdisk_id='',reservation_id='r-3v58ijrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1080438680',owner_user_name='tempest-TaggedBootDevicesTest_v242-1080438680-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1b3171253a417ea5fd59e5005d841e',uuid=1599d49e-fd6a-405a-9770-1a89cdc387cc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "address": "fa:16:3e:62:de:7e", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ed3217-9d", "ovs_interfaceid": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converting VIF {"id": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "address": "fa:16:3e:62:de:7e", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ed3217-9d", "ovs_interfaceid": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:7e,bridge_name='br-int',has_traffic_filtering=True,id=41ed3217-9db5-4ce0-8d39-bd262fd517ca,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41ed3217-9d') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:7e,bridge_name='br-int',has_traffic_filtering=True,id=41ed3217-9db5-4ce0-8d39-bd262fd517ca,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41ed3217-9d') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41ed3217-9d, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:10:19 user nova-compute[74963]: INFO os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:7e,bridge_name='br-int',has_traffic_filtering=True,id=41ed3217-9db5-4ce0-8d39-bd262fd517ca,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41ed3217-9d')
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-966211982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-966211982',id=13,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe/VnaSC4rhdvU8SqZHU7RgJU3M8lwMzvrQ2Gz7R1+64LQdlGLO2XbeZFZJsqiFn0s867nJ5kuFNJ7qfZ9He0S6rElnOysUzLLkc/sFUdNWKlFzc1Ir8QgZjVETUa+sQw==',key_name='tempest-keypair-750191969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ccae4f8cabf46389a90e7f1560ab091',ramdisk_id='',reservation_id='r-3v58ijrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1080438680',owner_user_name='tempest-TaggedBootDevicesTest_v242-1080438680-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1b3171253a417ea5fd59e5005d841e',uuid=1599d49e-fd6a-405a-9770-1a89cdc387cc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "address": "fa:16:3e:ac:43:72", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ad193a-0a", "ovs_interfaceid": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converting VIF {"id": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "address": "fa:16:3e:ac:43:72", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ad193a-0a", "ovs_interfaceid": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:43:72,bridge_name='br-int',has_traffic_filtering=True,id=51ad193a-0a2f-4dcc-8d08-323afb42d2cf,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51ad193a-0a') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:43:72,bridge_name='br-int',has_traffic_filtering=True,id=51ad193a-0a2f-4dcc-8d08-323afb42d2cf,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51ad193a-0a') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ad193a-0a, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:10:19 user nova-compute[74963]: INFO os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:43:72,bridge_name='br-int',has_traffic_filtering=True,id=51ad193a-0a2f-4dcc-8d08-323afb42d2cf,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51ad193a-0a')
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-966211982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-966211982',id=13,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe/VnaSC4rhdvU8SqZHU7RgJU3M8lwMzvrQ2Gz7R1+64LQdlGLO2XbeZFZJsqiFn0s867nJ5kuFNJ7qfZ9He0S6rElnOysUzLLkc/sFUdNWKlFzc1Ir8QgZjVETUa+sQw==',key_name='tempest-keypair-750191969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ccae4f8cabf46389a90e7f1560ab091',ramdisk_id='',reservation_id='r-3v58ijrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1080438680',owner_user_name='tempest-TaggedBootDevicesTest_v242-1080438680-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1b3171253a417ea5fd59e5005d841e',uuid=1599d49e-fd6a-405a-9770-1a89cdc387cc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "address": "fa:16:3e:05:22:29", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab29c93-63", "ovs_interfaceid": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converting VIF {"id": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "address": "fa:16:3e:05:22:29", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab29c93-63", "ovs_interfaceid": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:22:29,bridge_name='br-int',has_traffic_filtering=True,id=9ab29c93-636d-40ef-b98c-8af8b9db551d,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab29c93-63') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:22:29,bridge_name='br-int',has_traffic_filtering=True,id=9ab29c93-636d-40ef-b98c-8af8b9db551d,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab29c93-63') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ab29c93-63, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:10:19 user nova-compute[74963]: INFO os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:22:29,bridge_name='br-int',has_traffic_filtering=True,id=9ab29c93-636d-40ef-b98c-8af8b9db551d,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab29c93-63')
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-966211982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-966211982',id=13,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe/VnaSC4rhdvU8SqZHU7RgJU3M8lwMzvrQ2Gz7R1+64LQdlGLO2XbeZFZJsqiFn0s867nJ5kuFNJ7qfZ9He0S6rElnOysUzLLkc/sFUdNWKlFzc1Ir8QgZjVETUa+sQw==',key_name='tempest-keypair-750191969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ccae4f8cabf46389a90e7f1560ab091',ramdisk_id='',reservation_id='r-3v58ijrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1080438680',owner_user_name='tempest-TaggedBootDevicesTest_v242-1080438680-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1b3171253a417ea5fd59e5005d841e',uuid=1599d49e-fd6a-405a-9770-1a89cdc387cc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "address": "fa:16:3e:87:df:de", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f5cd1-04", "ovs_interfaceid": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converting VIF {"id": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "address": "fa:16:3e:87:df:de", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f5cd1-04", "ovs_interfaceid": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:df:de,bridge_name='br-int',has_traffic_filtering=True,id=fc3f5cd1-044e-4b02-b62b-0d4d80b4a500,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f5cd1-04') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:df:de,bridge_name='br-int',has_traffic_filtering=True,id=fc3f5cd1-044e-4b02-b62b-0d4d80b4a500,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f5cd1-04') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc3f5cd1-04, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:10:19 user nova-compute[74963]: INFO os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:df:de,bridge_name='br-int',has_traffic_filtering=True,id=fc3f5cd1-044e-4b02-b62b-0d4d80b4a500,network=Network(1af90e12-ab9a-4499-90b3-858ecbdfb171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f5cd1-04')
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-966211982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-966211982',id=13,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe/VnaSC4rhdvU8SqZHU7RgJU3M8lwMzvrQ2Gz7R1+64LQdlGLO2XbeZFZJsqiFn0s867nJ5kuFNJ7qfZ9He0S6rElnOysUzLLkc/sFUdNWKlFzc1Ir8QgZjVETUa+sQw==',key_name='tempest-keypair-750191969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ccae4f8cabf46389a90e7f1560ab091',ramdisk_id='',reservation_id='r-3v58ijrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1080438680',owner_user_name='tempest-TaggedBootDevicesTest_v242-1080438680-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1b3171253a417ea5fd59e5005d841e',uuid=1599d49e-fd6a-405a-9770-1a89cdc387cc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "address": "fa:16:3e:bc:52:4b", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26682746-df", "ovs_interfaceid": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converting VIF {"id": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "address": "fa:16:3e:bc:52:4b", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26682746-df", "ovs_interfaceid": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:52:4b,bridge_name='br-int',has_traffic_filtering=True,id=26682746-dfc0-42f2-8c4c-a4d35c39f627,network=Network(3b07f5ee-41b6-4973-9107-597876156e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26682746-df') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:52:4b,bridge_name='br-int',has_traffic_filtering=True,id=26682746-dfc0-42f2-8c4c-a4d35c39f627,network=Network(3b07f5ee-41b6-4973-9107-597876156e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26682746-df') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26682746-df, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:10:19 user nova-compute[74963]: INFO os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:52:4b,bridge_name='br-int',has_traffic_filtering=True,id=26682746-dfc0-42f2-8c4c-a4d35c39f627,network=Network(3b07f5ee-41b6-4973-9107-597876156e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26682746-df')
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-966211982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-966211982',id=13,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe/VnaSC4rhdvU8SqZHU7RgJU3M8lwMzvrQ2Gz7R1+64LQdlGLO2XbeZFZJsqiFn0s867nJ5kuFNJ7qfZ9He0S6rElnOysUzLLkc/sFUdNWKlFzc1Ir8QgZjVETUa+sQw==',key_name='tempest-keypair-750191969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ccae4f8cabf46389a90e7f1560ab091',ramdisk_id='',reservation_id='r-3v58ijrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1080438680',owner_user_name='tempest-TaggedBootDevicesTest_v242-1080438680-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1b3171253a417ea5fd59e5005d841e',uuid=1599d49e-fd6a-405a-9770-1a89cdc387cc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "address": "fa:16:3e:28:f0:52", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f019e2-4e", "ovs_interfaceid": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converting VIF {"id": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "address": "fa:16:3e:28:f0:52", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f019e2-4e", "ovs_interfaceid": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:f0:52,bridge_name='br-int',has_traffic_filtering=True,id=47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5,network=Network(3b07f5ee-41b6-4973-9107-597876156e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f019e2-4e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f0:52,bridge_name='br-int',has_traffic_filtering=True,id=47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5,network=Network(3b07f5ee-41b6-4973-9107-597876156e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f019e2-4e') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47f019e2-4e, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:10:19 user nova-compute[74963]: INFO os_vif [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f0:52,bridge_name='br-int',has_traffic_filtering=True,id=47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5,network=Network(3b07f5ee-41b6-4973-9107-597876156e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f019e2-4e')
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Unplugged VIFs for instance {{(pid=74963) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updated VIF entry in instance network info cache for port 26682746-dfc0-42f2-8c4c-a4d35c39f627. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating instance_info_cache with network_info: [{"id": "67c60162-0d3e-44c3-92fd-6331f799d72d", "address": "fa:16:3e:37:65:30", "network": {"id": "99b1450d-f62f-4706-b397-1b4a3d7b8697", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-363608409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c60162-0d", "ovs_interfaceid": "67c60162-0d3e-44c3-92fd-6331f799d72d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "address": "fa:16:3e:62:de:7e", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ed3217-9d", "ovs_interfaceid": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "address": "fa:16:3e:ac:43:72", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ad193a-0a", "ovs_interfaceid": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "address": "fa:16:3e:05:22:29", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab29c93-63", "ovs_interfaceid": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "address": "fa:16:3e:87:df:de", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f5cd1-04", "ovs_interfaceid": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "address": "fa:16:3e:bc:52:4b", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26682746-df", "ovs_interfaceid": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "address": "fa:16:3e:28:f0:52", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f019e2-4e", "ovs_interfaceid": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] Releasing lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Received event network-changed-47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing instance network info cache due to event network-changed-47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] Acquiring lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] Acquired lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Refreshing network info cache for port 47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-dc27ae1b-97da-43ac-b0d4-69330966e9f0 req-7e5de131-0c0d-43b6-a53d-5ec2e2ebccc7 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-unplugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc27ae1b-97da-43ac-b0d4-69330966e9f0 req-7e5de131-0c0d-43b6-a53d-5ec2e2ebccc7 service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc27ae1b-97da-43ac-b0d4-69330966e9f0 req-7e5de131-0c0d-43b6-a53d-5ec2e2ebccc7 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc27ae1b-97da-43ac-b0d4-69330966e9f0 req-7e5de131-0c0d-43b6-a53d-5ec2e2ebccc7 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-dc27ae1b-97da-43ac-b0d4-69330966e9f0 req-7e5de131-0c0d-43b6-a53d-5ec2e2ebccc7 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-unplugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:19 user nova-compute[74963]: WARNING nova.compute.manager [req-dc27ae1b-97da-43ac-b0d4-69330966e9f0 req-7e5de131-0c0d-43b6-a53d-5ec2e2ebccc7 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-unplugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state active and task_state resize_migrating.
Nov 30 08:10:19 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance destroyed successfully.
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1915210269',display_name='tempest-ServerActionsTestOtherB-server-1915210269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1915210269',id=1,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36ci9r8PQsZAIlncqo2lnhzQxOBqtCX/Nhuwzpg/1rHe+dDRDEWc3NXIhEOThN+3uJ2JkTtQ14Ec2v58DN2WowXRvVjxsTkVJ/eZYNznnLTsNFO26FNZYoSoo9gHV1uA==',key_name='tempest-keypair-1061087135',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb3709ed7b39464eb736837ee9167d04',ramdisk_id='',reservation_id='r-ij7puok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1961924021',owner_user_name='tempest-ServerActionsTestOtherB-1961924021-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='709296ad4feb46a580f22f79a87233b4',uuid=3551893b-4a59-4e6a-a961-8ea6d671632e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1853256577-network", "vif_mac": "fa:16:3e:35:ea:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converting VIF {"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1853256577-network", "vif_mac": "fa:16:3e:35:ea:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_vif [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f867ffa-ae, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10bfc461-52c3-45bb-962d-4c7dcac22ead) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:19 user nova-compute[74963]: INFO os_vif [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae')
Nov 30 08:10:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:10:19 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0b8241-bcf5-4fa9-9d87-0e0f6642a4e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:10:19 user nova-compute[74963]: No targets found.
Nov 30 08:10:19 user nova-compute[74963]: iSNS:
Nov 30 08:10:19 user nova-compute[74963]: No targets found.
Nov 30 08:10:19 user nova-compute[74963]: STATIC:
Nov 30 08:10:19 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16
Nov 30 08:10:19 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:19 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:19 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:10:19 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:19 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:19 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0
Nov 30 08:10:19 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:19 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:19 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a
Nov 30 08:10:19 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:19 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:19 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:10:19 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:19 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:19 user nova-compute[74963]: FIRMWARE:
Nov 30 08:10:19 user nova-compute[74963]: No targets found.
Nov 30 08:10:19 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:10:19 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:10:19 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeacf330-6ea5-4632-b207-d95fd7b01b49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02a57d4-0acf-4fc3-a7d9-1a34c2daa5c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:19 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:19 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:19 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:19 user nova-compute[74963]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:19 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:19 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:19 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:19 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:19 user nova-compute[74963]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:19 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62445e2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036'): ({'sdf'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Removing single pathed devices sdf {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:10:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb1202-c16e-4faa-bd06-31a42c63870b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23df8df-51cd-4132-8c65-517217c9ed46]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Flushing IO for device /dev/sdf {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f8977a-0b4b-4a25-bb97-9840aef15d2f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[db20216f-f52e-44e7-9a4a-06f498fe6e7f]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a57b20-264c-455d-b9ad-383d44c371a1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e08624-54db-4b66-92a3-e8a439cf2c9b]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]
Nov 30 08:10:20 user nova-compute[74963]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.
Nov 30 08:10:20 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6476b3-a610-4e12-af00-1abecd08142f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] <== disconnect_volume: return (325ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updated VIF entry in instance network info cache for port 47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating instance_info_cache with network_info: [{"id": "67c60162-0d3e-44c3-92fd-6331f799d72d", "address": "fa:16:3e:37:65:30", "network": {"id": "99b1450d-f62f-4706-b397-1b4a3d7b8697", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-363608409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c60162-0d", "ovs_interfaceid": "67c60162-0d3e-44c3-92fd-6331f799d72d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "address": "fa:16:3e:62:de:7e", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ed3217-9d", "ovs_interfaceid": "41ed3217-9db5-4ce0-8d39-bd262fd517ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "address": "fa:16:3e:ac:43:72", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ad193a-0a", "ovs_interfaceid": "51ad193a-0a2f-4dcc-8d08-323afb42d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "address": "fa:16:3e:05:22:29", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab29c93-63", "ovs_interfaceid": "9ab29c93-636d-40ef-b98c-8af8b9db551d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "address": "fa:16:3e:87:df:de", "network": {"id": "1af90e12-ab9a-4499-90b3-858ecbdfb171", "bridge": "br-int", "label": "tempest-device-tagging-net1-964083741", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f5cd1-04", "ovs_interfaceid": "fc3f5cd1-044e-4b02-b62b-0d4d80b4a500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "address": "fa:16:3e:bc:52:4b", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26682746-df", "ovs_interfaceid": "26682746-dfc0-42f2-8c4c-a4d35c39f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "address": "fa:16:3e:28:f0:52", "network": {"id": "3b07f5ee-41b6-4973-9107-597876156e6f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1268162173", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1ccae4f8cabf46389a90e7f1560ab091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f019e2-4e", "ovs_interfaceid": "47f019e2-4ef1-44e8-81c2-4dc5c83fe3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-73914c1c-d6c6-477e-a1c0-56ae8e082040 req-48f6c453-60d7-4460-9e2e-ad998987b509 service nova] Releasing lock "refresh_cache-1599d49e-fd6a-405a-9770-1a89cdc387cc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:10:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e_resize/disk /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "cp -r /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e_resize/disk /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk" returned: 0 in 0.450s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e_resize/disk.info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk.info {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "cp -r /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e_resize/disk.info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk.info" returned: 0 in 0.034s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-4bf24a81-22de-49e6-9acd-ba27696b163e req-ecd88c49-ac82-4db2-9b8e-cde84a1d513f service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4bf24a81-22de-49e6-9acd-ba27696b163e req-ecd88c49-ac82-4db2-9b8e-cde84a1d513f service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4bf24a81-22de-49e6-9acd-ba27696b163e req-ecd88c49-ac82-4db2-9b8e-cde84a1d513f service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4bf24a81-22de-49e6-9acd-ba27696b163e req-ecd88c49-ac82-4db2-9b8e-cde84a1d513f service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-4bf24a81-22de-49e6-9acd-ba27696b163e req-ecd88c49-ac82-4db2-9b8e-cde84a1d513f service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:21 user nova-compute[74963]: WARNING nova.compute.manager [req-4bf24a81-22de-49e6-9acd-ba27696b163e req-ecd88c49-ac82-4db2-9b8e-cde84a1d513f service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state active and task_state resize_migrating.
Nov 30 08:10:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Port 9f867ffa-aeb8-4693-bce5-c4e507fad1a2 binding to destination host user is already ACTIVE {{(pid=74963) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquired lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Releasing lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG os_brick.utils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b7d130-3638-4db7-b295-96f3737a5207]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc5da5c-2391-4995-8b85-848b17ce4389]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73236f6-f641-4c91-b895-f60525fb1676]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[226c51cd-200b-4e62-8e44-cb199621f2d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:10:24 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[76743b44-422e-4a47-9c30-359556147452]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG os_brick.utils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:10:24 user nova-compute[74963]: INFO nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Took 4.70 seconds to deallocate network for instance.
Nov 30 08:10:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Detaching volume: c7f98678-6588-4993-bd49-639aa42a0d81 {{(pid=74963) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 30 08:10:24 user nova-compute[74963]: INFO nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Detaching volume c7f98678-6588-4993-bd49-639aa42a0d81
Nov 30 08:10:24 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Skipping driver_detach during remote rebuild. {{(pid=74963) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 30 08:10:24 user nova-compute[74963]: WARNING nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Failed to detach volume: c7f98678-6588-4993-bd49-639aa42a0d81 due to 'NoneType' object has no attribute 'devices'
Nov 30 08:10:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Detaching volume: f61ba7e5-b68c-44b8-a531-f2bb0dc8445b {{(pid=74963) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 30 08:10:24 user nova-compute[74963]: INFO nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Detaching volume f61ba7e5-b68c-44b8-a531-f2bb0dc8445b
Nov 30 08:10:24 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Skipping driver_detach during remote rebuild. {{(pid=74963) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 30 08:10:24 user nova-compute[74963]: WARNING nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Failed to detach volume: f61ba7e5-b68c-44b8-a531-f2bb0dc8445b due to 'NoneType' object has no attribute 'devices'
Nov 30 08:10:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Detaching volume: 57eb47ab-e14d-471e-ba66-02f63b81ade5 {{(pid=74963) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 30 08:10:24 user nova-compute[74963]: INFO nova.compute.manager [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Detaching volume 57eb47ab-e14d-471e-ba66-02f63b81ade5
Nov 30 08:10:24 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] [instance: 1599d49e-fd6a-405a-9770-1a89cdc387cc] Skipping driver_detach during remote rebuild. {{(pid=74963) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 30 08:10:24 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Deleted allocations for instance 1599d49e-fd6a-405a-9770-1a89cdc387cc
Nov 30 08:10:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7988de7d-3e45-4b9e-9145-cc663ff27ceb tempest-TaggedBootDevicesTest_v242-1080438680 tempest-TaggedBootDevicesTest_v242-1080438680-project-member] Lock "1599d49e-fd6a-405a-9770-1a89cdc387cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.906s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Starting finish_migration {{(pid=74963) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance directory exists: not creating {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 08:10:33 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Creating image(s)
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk. size=21474836480 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk 21474836480 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk 21474836480" returned: 0 in 0.054s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Ensure instance console log exists: /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Start _get_guest_xml network_info=[{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1853256577-network", "vif_mac": "fa:16:3e:35:ea:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3551893b-4a59-4e6a-a961-8ea6d671632e', 'attached_at': '2023-11-30T08:10:33.000000', 'detached_at': '', 'volume_id': '0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'serial': '0705d8a6-7d88-49a3-b0c9-341d67e1c036'}, 'attachment_id': '08e236c6-b660-4a1d-b9e1-097737a33e6d', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:10:33 user nova-compute[74963]: INFO nova.compute.claims [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Claim successful on node user
Nov 30 08:10:33 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:10:33 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:10:33 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:33 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:33 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e605c5-e35d-4c6b-98cf-4787ef331541]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:10:33 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[017a8ac5-e1d7-40cd-be41-e01130aff4b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036] added
Nov 30 08:10:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ce2929-c5b5-4c40-86fe-f19504cf18da]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bba786-cd40-4dd0-a60b-66e0335fb249]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzlsTFwc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzlsTFwc" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d4fe47-937d-4f05-9758-716b98cadf09]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yzlsTFwc'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0fb6a0-da18-4f0d-a866-a33af4713a75]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00bf527-1861-4842-96e1-eef2b0668c37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c26449-121b-4b9a-8298-4cb4982a5221]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]
Nov 30 08:10:34 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.
Nov 30 08:10:34 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55a1436-b033-4de6-bbb6-37b3ffb23e42]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77b493a-bd0e-4b40-88e9-b729aaede328]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:34 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[31962ec6-9a5a-4e28-ad7c-6d88b6b66bff]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:10:34 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:10:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG nova.policy [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85ae318785fd41ec87f9598fd18c593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a587ec45f21498ea140a9989398052e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:10:34 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Creating image(s)
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "/opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "/opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk 1073741824" returned: 0 in 0.050s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Successfully created port: 6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c is timed out.
Nov 30 08:10:35 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Successfully detached device vdc from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c from the live domain config.
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvaebyBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:10:35 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23337653934356136', 'path': '/dev/sdf'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337653934356136', 'path': '/dev/sdf'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.063s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4800f6a-7318-439d-86fa-e74753d26a7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:10:35 user nova-compute[74963]: No targets found.
Nov 30 08:10:35 user nova-compute[74963]: iSNS:
Nov 30 08:10:35 user nova-compute[74963]: No targets found.
Nov 30 08:10:35 user nova-compute[74963]: STATIC:
Nov 30 08:10:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16
Nov 30 08:10:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:10:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0
Nov 30 08:10:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a
Nov 30 08:10:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:10:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:35 user nova-compute[74963]: FIRMWARE:
Nov 30 08:10:35 user nova-compute[74963]: No targets found.
Nov 30 08:10:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:10:35 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:10:35 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1915210269',display_name='tempest-ServerActionsTestOtherB-server-1915210269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1915210269',id=1,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36ci9r8PQsZAIlncqo2lnhzQxOBqtCX/Nhuwzpg/1rHe+dDRDEWc3NXIhEOThN+3uJ2JkTtQ14Ec2v58DN2WowXRvVjxsTkVJ/eZYNznnLTsNFO26FNZYoSoo9gHV1uA==',key_name='tempest-keypair-1061087135',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb3709ed7b39464eb736837ee9167d04',ramdisk_id='',reservation_id='r-ij7puok0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1961924021',owner_user_name='tempest-ServerActionsTestOtherB-1961924021-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='709296ad4feb46a580f22f79a87233b4',uuid=3551893b-4a59-4e6a-a961-8ea6d671632e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1853256577-network", "vif_mac": "fa:16:3e:35:ea:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converting VIF {"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1853256577-network", "vif_mac": "fa:16:3e:35:ea:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:10:35 user nova-compute[74963]:   <uuid>3551893b-4a59-4e6a-a961-8ea6d671632e</uuid>
Nov 30 08:10:35 user nova-compute[74963]:   <name>instance-00000001</name>
Nov 30 08:10:35 user nova-compute[74963]:   <memory>2097152</memory>
Nov 30 08:10:35 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:10:35 user nova-compute[74963]:   <metadata>
Nov 30 08:10:35 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:10:35 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:10:35 user nova-compute[74963]:       <nova:name>tempest-ServerActionsTestOtherB-server-1915210269</nova:name>
Nov 30 08:10:35 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:10:33</nova:creationTime>
Nov 30 08:10:35 user nova-compute[74963]:       <nova:flavor name="m1.small">
Nov 30 08:10:35 user nova-compute[74963]:         <nova:memory>2048</nova:memory>
Nov 30 08:10:35 user nova-compute[74963]:         <nova:disk>20</nova:disk>
Nov 30 08:10:35 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:10:35 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:10:35 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:10:35 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:10:35 user nova-compute[74963]:       <nova:owner>
Nov 30 08:10:35 user nova-compute[74963]:         <nova:user uuid="709296ad4feb46a580f22f79a87233b4">tempest-ServerActionsTestOtherB-1961924021-project-member</nova:user>
Nov 30 08:10:35 user nova-compute[74963]:         <nova:project uuid="fb3709ed7b39464eb736837ee9167d04">tempest-ServerActionsTestOtherB-1961924021</nova:project>
Nov 30 08:10:35 user nova-compute[74963]:       </nova:owner>
Nov 30 08:10:35 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:10:35 user nova-compute[74963]:       <nova:ports>
Nov 30 08:10:35 user nova-compute[74963]:         <nova:port uuid="9f867ffa-aeb8-4693-bce5-c4e507fad1a2">
Nov 30 08:10:35 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 08:10:35 user nova-compute[74963]:         </nova:port>
Nov 30 08:10:35 user nova-compute[74963]:       </nova:ports>
Nov 30 08:10:35 user nova-compute[74963]:     </nova:instance>
Nov 30 08:10:35 user nova-compute[74963]:   </metadata>
Nov 30 08:10:35 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:10:35 user nova-compute[74963]:     <system>
Nov 30 08:10:35 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:10:35 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:10:35 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:10:35 user nova-compute[74963]:       <entry name="serial">3551893b-4a59-4e6a-a961-8ea6d671632e</entry>
Nov 30 08:10:35 user nova-compute[74963]:       <entry name="uuid">3551893b-4a59-4e6a-a961-8ea6d671632e</entry>
Nov 30 08:10:35 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:10:35 user nova-compute[74963]:     </system>
Nov 30 08:10:35 user nova-compute[74963]:   </sysinfo>
Nov 30 08:10:35 user nova-compute[74963]:   <os>
Nov 30 08:10:35 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:10:35 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:10:35 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:10:35 user nova-compute[74963]:   </os>
Nov 30 08:10:35 user nova-compute[74963]:   <features>
Nov 30 08:10:35 user nova-compute[74963]:     <acpi/>
Nov 30 08:10:35 user nova-compute[74963]:     <apic/>
Nov 30 08:10:35 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:10:35 user nova-compute[74963]:   </features>
Nov 30 08:10:35 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:10:35 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:10:35 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:10:35 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:10:35 user nova-compute[74963]:   </clock>
Nov 30 08:10:35 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:10:35 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:10:35 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:10:35 user nova-compute[74963]:   </cpu>
Nov 30 08:10:35 user nova-compute[74963]:   <devices>
Nov 30 08:10:35 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:10:35 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:10:35 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk"/>
Nov 30 08:10:35 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:10:35 user nova-compute[74963]:     </disk>
Nov 30 08:10:35 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:10:35 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:10:35 user nova-compute[74963]:       <source dev="/dev/sdf"/>
Nov 30 08:10:35 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:10:35 user nova-compute[74963]:       <serial>0705d8a6-7d88-49a3-b0c9-341d67e1c036</serial>
Nov 30 08:10:35 user nova-compute[74963]:     </disk>
Nov 30 08:10:35 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:10:35 user nova-compute[74963]:       <mac address="fa:16:3e:35:ea:ab"/>
Nov 30 08:10:35 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:10:35 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:10:35 user nova-compute[74963]:       <target dev="tap9f867ffa-ae"/>
Nov 30 08:10:35 user nova-compute[74963]:     </interface>
Nov 30 08:10:35 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:10:35 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/console.log" append="off"/>
Nov 30 08:10:35 user nova-compute[74963]:     </serial>
Nov 30 08:10:35 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:10:35 user nova-compute[74963]:     <video>
Nov 30 08:10:35 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:10:35 user nova-compute[74963]:     </video>
Nov 30 08:10:35 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:10:35 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:10:35 user nova-compute[74963]:     </rng>
Nov 30 08:10:35 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:10:35 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:10:35 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:10:35 user nova-compute[74963]:     </memballoon>
Nov 30 08:10:35 user nova-compute[74963]:   </devices>
Nov 30 08:10:35 user nova-compute[74963]: </domain>
Nov 30 08:10:35 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1915210269',display_name='tempest-ServerActionsTestOtherB-server-1915210269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1915210269',id=1,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36ci9r8PQsZAIlncqo2lnhzQxOBqtCX/Nhuwzpg/1rHe+dDRDEWc3NXIhEOThN+3uJ2JkTtQ14Ec2v58DN2WowXRvVjxsTkVJ/eZYNznnLTsNFO26FNZYoSoo9gHV1uA==',key_name='tempest-keypair-1061087135',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb3709ed7b39464eb736837ee9167d04',ramdisk_id='',reservation_id='r-ij7puok0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1961924021',owner_user_name='tempest-ServerActionsTestOtherB-1961924021-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='709296ad4feb46a580f22f79a87233b4',uuid=3551893b-4a59-4e6a-a961-8ea6d671632e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1853256577-network", "vif_mac": "fa:16:3e:35:ea:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converting VIF {"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1853256577-network", "vif_mac": "fa:16:3e:35:ea:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_vif [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f08e28-01c1-49d7-8583-edf23dba4588]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b887bd5e-e847-5e94-90fa-ec02966b888b', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f867ffa-ae, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f867ffa-ae, col_values=(('qos', UUID('cfe7b211-83dc-4a3b-be68-61cfffb857c0')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f867ffa-ae, col_values=(('external_ids', {'iface-id': '9f867ffa-aeb8-4693-bce5-c4e507fad1a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:ea:ab', 'vm-uuid': '3551893b-4a59-4e6a-a961-8ea6d671632e'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Cannot resize image /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Ensure instance console log exists: /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:10:35 user nova-compute[74963]: INFO os_vif [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae')
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[993b6ad5-c28d-443a-b8b9-03c1ae7ce4ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:35 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:35 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:35 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:35 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:35 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:35 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:35 user nova-compute[74963]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 (non-flash)
Nov 30 08:10:35 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622058d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53a2045-20f9-450c-949b-6658f5e48216]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fe31d8-a0c7-4be1-8860-c45a6fdd4a00]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] No VIF found with MAC fa:16:3e:35:ea:ab, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4f502c-3cb5-4e2c-9dda-4a828226d32b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5088a01c-803a-45c5-94e1-3f1f9d7b8f12]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a7797c-c6fa-44bc-a9ba-c4ca4cfc7cf8]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bb45ce-b74f-44ba-834d-c1886e86d650]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0, portal: 172.16.0.220,3260]
Nov 30 08:10:35 user nova-compute[74963]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0, portal: 172.16.0.220,3260] successful.
Nov 30 08:10:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23624b43-265b-413f-b417-bbb4b40abbe0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fd5a07-567a-4e5b-a130-69aadbab5f41]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] <== disconnect_volume: return (412ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Successfully updated port: 6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "refresh_cache-bb855029-8201-4c59-a4d2-3fac4a14fec9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquired lock "refresh_cache-bb855029-8201-4c59-a4d2-3fac4a14fec9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-7d5597a0-0b7c-4e62-9cf6-c6ace6d095cd req-870a0de2-0c42-4bbe-86b0-91b8e8f8b7bd service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received event network-changed-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-7d5597a0-0b7c-4e62-9cf6-c6ace6d095cd req-870a0de2-0c42-4bbe-86b0-91b8e8f8b7bd service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Refreshing instance network info cache due to event network-changed-6644ce62-9413-492a-9550-0969a30b8e50. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:10:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7d5597a0-0b7c-4e62-9cf6-c6ace6d095cd req-870a0de2-0c42-4bbe-86b0-91b8e8f8b7bd service nova] Acquiring lock "refresh_cache-bb855029-8201-4c59-a4d2-3fac4a14fec9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Updating instance_info_cache with network_info: [{"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Releasing lock "refresh_cache-bb855029-8201-4c59-a4d2-3fac4a14fec9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Instance network_info: |[{"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7d5597a0-0b7c-4e62-9cf6-c6ace6d095cd req-870a0de2-0c42-4bbe-86b0-91b8e8f8b7bd service nova] Acquired lock "refresh_cache-bb855029-8201-4c59-a4d2-3fac4a14fec9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.network.neutron [req-7d5597a0-0b7c-4e62-9cf6-c6ace6d095cd req-870a0de2-0c42-4bbe-86b0-91b8e8f8b7bd service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Refreshing network info cache for port 6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Start _get_guest_xml network_info=[{"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:10:36 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:10:36 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-902447542',display_name='tempest-VolumesAdminNegativeTest-server-902447542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-902447542',id=14,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCUA2w3dykG0qemP6SHe5PR2KxuUnpCOZvjUzicHWyg0U7qEuUH7EnbWVEfXUOvEHNjBBK7IgFBh2Ciy/FO3J3qtuAuHGfKKlxqUj7C354uviEh5RWey/h5PQcUMwtd1A==',key_name='tempest-keypair-1495260622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a587ec45f21498ea140a9989398052e',ramdisk_id='',reservation_id='r-dd04i4n8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1226639972',owner_user_name='tempest-VolumesAdminNegativeTest-1226639972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85ae318785fd41ec87f9598fd18c593a',uuid=bb855029-8201-4c59-a4d2-3fac4a14fec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converting VIF {"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:bc:97,bridge_name='br-int',has_traffic_filtering=True,id=6644ce62-9413-492a-9550-0969a30b8e50,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6644ce62-94') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lazy-loading 'pci_devices' on Instance uuid bb855029-8201-4c59-a4d2-3fac4a14fec9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:10:36 user nova-compute[74963]:   <uuid>bb855029-8201-4c59-a4d2-3fac4a14fec9</uuid>
Nov 30 08:10:36 user nova-compute[74963]:   <name>instance-0000000e</name>
Nov 30 08:10:36 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:10:36 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:10:36 user nova-compute[74963]:   <metadata>
Nov 30 08:10:36 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:10:36 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:10:36 user nova-compute[74963]:       <nova:name>tempest-VolumesAdminNegativeTest-server-902447542</nova:name>
Nov 30 08:10:36 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:10:36</nova:creationTime>
Nov 30 08:10:36 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:10:36 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:10:36 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:10:36 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:10:36 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:10:36 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:10:36 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:10:36 user nova-compute[74963]:       <nova:owner>
Nov 30 08:10:36 user nova-compute[74963]:         <nova:user uuid="85ae318785fd41ec87f9598fd18c593a">tempest-VolumesAdminNegativeTest-1226639972-project-member</nova:user>
Nov 30 08:10:36 user nova-compute[74963]:         <nova:project uuid="6a587ec45f21498ea140a9989398052e">tempest-VolumesAdminNegativeTest-1226639972</nova:project>
Nov 30 08:10:36 user nova-compute[74963]:       </nova:owner>
Nov 30 08:10:36 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:10:36 user nova-compute[74963]:       <nova:ports>
Nov 30 08:10:36 user nova-compute[74963]:         <nova:port uuid="6644ce62-9413-492a-9550-0969a30b8e50">
Nov 30 08:10:36 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 08:10:36 user nova-compute[74963]:         </nova:port>
Nov 30 08:10:36 user nova-compute[74963]:       </nova:ports>
Nov 30 08:10:36 user nova-compute[74963]:     </nova:instance>
Nov 30 08:10:36 user nova-compute[74963]:   </metadata>
Nov 30 08:10:36 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:10:36 user nova-compute[74963]:     <system>
Nov 30 08:10:36 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:10:36 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:10:36 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:10:36 user nova-compute[74963]:       <entry name="serial">bb855029-8201-4c59-a4d2-3fac4a14fec9</entry>
Nov 30 08:10:36 user nova-compute[74963]:       <entry name="uuid">bb855029-8201-4c59-a4d2-3fac4a14fec9</entry>
Nov 30 08:10:36 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:10:36 user nova-compute[74963]:     </system>
Nov 30 08:10:36 user nova-compute[74963]:   </sysinfo>
Nov 30 08:10:36 user nova-compute[74963]:   <os>
Nov 30 08:10:36 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:10:36 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:10:36 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:10:36 user nova-compute[74963]:   </os>
Nov 30 08:10:36 user nova-compute[74963]:   <features>
Nov 30 08:10:36 user nova-compute[74963]:     <acpi/>
Nov 30 08:10:36 user nova-compute[74963]:     <apic/>
Nov 30 08:10:36 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:10:36 user nova-compute[74963]:   </features>
Nov 30 08:10:36 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:10:36 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:10:36 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:10:36 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:10:36 user nova-compute[74963]:   </clock>
Nov 30 08:10:36 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:10:36 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:10:36 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:10:36 user nova-compute[74963]:   </cpu>
Nov 30 08:10:36 user nova-compute[74963]:   <devices>
Nov 30 08:10:36 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:10:36 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:10:36 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk"/>
Nov 30 08:10:36 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:10:36 user nova-compute[74963]:     </disk>
Nov 30 08:10:36 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:10:36 user nova-compute[74963]:       <mac address="fa:16:3e:46:bc:97"/>
Nov 30 08:10:36 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:10:36 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:10:36 user nova-compute[74963]:       <target dev="tap6644ce62-94"/>
Nov 30 08:10:36 user nova-compute[74963]:     </interface>
Nov 30 08:10:36 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:10:36 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/console.log" append="off"/>
Nov 30 08:10:36 user nova-compute[74963]:     </serial>
Nov 30 08:10:36 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:10:36 user nova-compute[74963]:     <video>
Nov 30 08:10:36 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:10:36 user nova-compute[74963]:     </video>
Nov 30 08:10:36 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:10:36 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:10:36 user nova-compute[74963]:     </rng>
Nov 30 08:10:36 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:10:36 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:10:36 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:10:36 user nova-compute[74963]:     </memballoon>
Nov 30 08:10:36 user nova-compute[74963]:   </devices>
Nov 30 08:10:36 user nova-compute[74963]: </domain>
Nov 30 08:10:36 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-902447542',display_name='tempest-VolumesAdminNegativeTest-server-902447542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-902447542',id=14,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCUA2w3dykG0qemP6SHe5PR2KxuUnpCOZvjUzicHWyg0U7qEuUH7EnbWVEfXUOvEHNjBBK7IgFBh2Ciy/FO3J3qtuAuHGfKKlxqUj7C354uviEh5RWey/h5PQcUMwtd1A==',key_name='tempest-keypair-1495260622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a587ec45f21498ea140a9989398052e',ramdisk_id='',reservation_id='r-dd04i4n8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1226639972',owner_user_name='tempest-VolumesAdminNegativeTest-1226639972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85ae318785fd41ec87f9598fd18c593a',uuid=bb855029-8201-4c59-a4d2-3fac4a14fec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converting VIF {"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:bc:97,bridge_name='br-int',has_traffic_filtering=True,id=6644ce62-9413-492a-9550-0969a30b8e50,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6644ce62-94') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG os_vif [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:bc:97,bridge_name='br-int',has_traffic_filtering=True,id=6644ce62-9413-492a-9550-0969a30b8e50,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6644ce62-94') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6426dcec-2086-5043-b0d1-cd7206a6ca7c', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6644ce62-94, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6644ce62-94, col_values=(('qos', UUID('1980b0c1-eb2d-4586-83a7-c5d05e8818e0')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6644ce62-94, col_values=(('external_ids', {'iface-id': '6644ce62-9413-492a-9550-0969a30b8e50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:bc:97', 'vm-uuid': 'bb855029-8201-4c59-a4d2-3fac4a14fec9'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:36 user nova-compute[74963]: INFO os_vif [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:bc:97,bridge_name='br-int',has_traffic_filtering=True,id=6644ce62-9413-492a-9550-0969a30b8e50,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6644ce62-94')
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.objects.instance [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lazy-loading 'flavor' on Instance uuid 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] No VIF found with MAC fa:16:3e:46:bc:97, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:10:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-31733bd9-4fbb-436e-ab53-0cf75b51d6db tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.236s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG nova.network.neutron [req-7d5597a0-0b7c-4e62-9cf6-c6ace6d095cd req-870a0de2-0c42-4bbe-86b0-91b8e8f8b7bd service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Updated VIF entry in instance network info cache for port 6644ce62-9413-492a-9550-0969a30b8e50. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG nova.network.neutron [req-7d5597a0-0b7c-4e62-9cf6-c6ace6d095cd req-870a0de2-0c42-4bbe-86b0-91b8e8f8b7bd service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Updating instance_info_cache with network_info: [{"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7d5597a0-0b7c-4e62-9cf6-c6ace6d095cd req-870a0de2-0c42-4bbe-86b0-91b8e8f8b7bd service nova] Releasing lock "refresh_cache-bb855029-8201-4c59-a4d2-3fac4a14fec9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:37 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67d99f85-78de-4702-aa55-758173230187 is timed out.
Nov 30 08:10:37 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully detached device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the live domain config.
Nov 30 08:10:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkIwiMtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:10:37 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4e91a-ad04-440b-a3f5-6054f9d84c43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:10:37 user nova-compute[74963]: No targets found.
Nov 30 08:10:37 user nova-compute[74963]: iSNS:
Nov 30 08:10:37 user nova-compute[74963]: No targets found.
Nov 30 08:10:37 user nova-compute[74963]: STATIC:
Nov 30 08:10:37 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16
Nov 30 08:10:37 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:37 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:37 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:10:37 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:37 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:37 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a
Nov 30 08:10:37 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:37 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:37 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:10:37 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:10:37 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:10:37 user nova-compute[74963]: FIRMWARE:
Nov 30 08:10:37 user nova-compute[74963]: No targets found.
Nov 30 08:10:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:10:37 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:10:37 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:37 user nova-compute[74963]: WARNING nova.compute.manager [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state active and task_state resize_finish.
Nov 30 08:10:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:37 user nova-compute[74963]: WARNING nova.compute.manager [req-7aeccad9-899d-4aae-92dc-9f3c59ef9b3a req-3f5c76d4-7313-43cb-b6dd-164e642651ff service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state active and task_state resize_finish.
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3987155b-a953-41f8-aca6-c4da74972401]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ef897-5810-42ff-8e75-e17e4b9b3d63]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:37 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:37 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:37 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:10:37 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:10:37 user nova-compute[74963]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 (non-flash)
Nov 30 08:10:37 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:10:37 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244156e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16'): ({'sde'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Removing single pathed devices sde {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e731ace-82fe-486d-91b3-55e76a707a92]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:37 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b0577f-a062-4234-8064-b59f9400c8a7]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Flushing IO for device /dev/sde {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d671e1-c2c0-4121-8a57-cec9d4a248c9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1941df-796d-4868-b245-5d5eaba2f6d0]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d48db6e-9224-443d-b2cb-404e4f60cd73]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[58805359-a0ef-4e49-b76f-59f5b0961794]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16, portal: 172.16.0.220,3260]
Nov 30 08:10:38 user nova-compute[74963]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16, portal: 172.16.0.220,3260] successful.
Nov 30 08:10:38 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:778cf0c1-1e27-41e4-b3aa-36c07d410e16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[75740143-b208-4073-9510-be3d1f6e0da3]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== disconnect_volume: return (329ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:38 user nova-compute[74963]: INFO nova.compute.manager [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Terminating instance
Nov 30 08:10:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-18b90357-715d-4b35-9029-f0a04f19d412 req-e6df44af-d80e-4c9a-82c4-b6568afe6b2f service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received event network-vif-plugged-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-18b90357-715d-4b35-9029-f0a04f19d412 req-e6df44af-d80e-4c9a-82c4-b6568afe6b2f service nova] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-18b90357-715d-4b35-9029-f0a04f19d412 req-e6df44af-d80e-4c9a-82c4-b6568afe6b2f service nova] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-18b90357-715d-4b35-9029-f0a04f19d412 req-e6df44af-d80e-4c9a-82c4-b6568afe6b2f service nova] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-18b90357-715d-4b35-9029-f0a04f19d412 req-e6df44af-d80e-4c9a-82c4-b6568afe6b2f service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] No waiting events found dispatching network-vif-plugged-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:38 user nova-compute[74963]: WARNING nova.compute.manager [req-18b90357-715d-4b35-9029-f0a04f19d412 req-e6df44af-d80e-4c9a-82c4-b6568afe6b2f service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received unexpected event network-vif-plugged-6644ce62-9413-492a-9550-0969a30b8e50 for instance with vm_state building and task_state spawning.
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Instance destroyed successfully.
Nov 30 08:10:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2f6b040d-ef9b-4a28-b730-1189669367e3 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.118s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lazy-loading 'resources' on Instance uuid 98e1c4f0-b628-435a-bf98-f814fa927873 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-670864781',display_name='tempest-TestVolumeSwap-server-670864781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-670864781',id=6,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbV5XlLnT/dacZAFYCI8rtB8uh7fUz02r2KaRAJtpzXC14nPacR+E1L9Kd9GR/LFaT6JcxA8TNp0pYahu/o964NPaoxMK6H9fuHg5D4yA5Vv2bVLj489Nl1g9dmiorSHQ==',key_name='tempest-keypair-671427234',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bb5e0955acb4580a76ec98a9233eb87',ramdisk_id='',reservation_id='r-0tj0n4h2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-265069428',owner_user_name='tempest-TestVolumeSwap-265069428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56ffed9753a4606b25aeba883c7a7cb',uuid=98e1c4f0-b628-435a-bf98-f814fa927873,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Converting VIF {"id": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "address": "fa:16:3e:a5:72:4e", "network": {"id": "9d5b9069-bd4b-4c7d-a2fa-003a11613793", "bridge": "br-int", "label": "tempest-TestVolumeSwap-916275629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bb5e0955acb4580a76ec98a9233eb87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5ec7a-bd", "ovs_interfaceid": "c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:72:4e,bridge_name='br-int',has_traffic_filtering=True,id=c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00,network=Network(9d5b9069-bd4b-4c7d-a2fa-003a11613793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5ec7a-bd') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG os_vif [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:72:4e,bridge_name='br-int',has_traffic_filtering=True,id=c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00,network=Network(9d5b9069-bd4b-4c7d-a2fa-003a11613793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5ec7a-bd') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3a5ec7a-bd, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6eeaf8a-0149-405d-8245-0e8e1289077c) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:10:39 user nova-compute[74963]: INFO os_vif [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:72:4e,bridge_name='br-int',has_traffic_filtering=True,id=c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00,network=Network(9d5b9069-bd4b-4c7d-a2fa-003a11613793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5ec7a-bd')
Nov 30 08:10:39 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Deleting instance files /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873_del
Nov 30 08:10:39 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Deletion of /opt/stack/data/nova/instances/98e1c4f0-b628-435a-bf98-f814fa927873_del complete
Nov 30 08:10:39 user nova-compute[74963]: INFO nova.compute.manager [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 30 08:10:39 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.compute.manager [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received event network-vif-unplugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.compute.manager [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] No waiting events found dispatching network-vif-unplugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.compute.manager [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received event network-vif-unplugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.compute.manager [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received event network-vif-plugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] Acquiring lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] Lock "98e1c4f0-b628-435a-bf98-f814fa927873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:39 user nova-compute[74963]: DEBUG nova.compute.manager [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] No waiting events found dispatching network-vif-plugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:39 user nova-compute[74963]: WARNING nova.compute.manager [req-f45b8dbe-47a7-4204-949f-4c2a9335cea2 req-58ed6323-52b3-4d9c-9871-6452e7c48317 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received unexpected event network-vif-plugged-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 for instance with vm_state active and task_state deleting.
Nov 30 08:10:40 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:40 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Took 1.21 seconds to deallocate network for instance.
Nov 30 08:10:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:40 user nova-compute[74963]: DEBUG nova.compute.manager [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:10:40 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance running successfully.
Nov 30 08:10:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Failed to set time: agent not configured {{(pid=74963) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 30 08:10:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-aecd2c7b-51f1-459f-8e56-3596f404b51a tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] finish_migration finished successfully. {{(pid=74963) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 30 08:10:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-3d260ae2-29bb-4b71-b0ed-b9dae0b1179a req-ea5e77e8-7225-412e-abd5-0be06b60c223 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received event network-vif-plugged-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3d260ae2-29bb-4b71-b0ed-b9dae0b1179a req-ea5e77e8-7225-412e-abd5-0be06b60c223 service nova] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3d260ae2-29bb-4b71-b0ed-b9dae0b1179a req-ea5e77e8-7225-412e-abd5-0be06b60c223 service nova] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3d260ae2-29bb-4b71-b0ed-b9dae0b1179a req-ea5e77e8-7225-412e-abd5-0be06b60c223 service nova] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-3d260ae2-29bb-4b71-b0ed-b9dae0b1179a req-ea5e77e8-7225-412e-abd5-0be06b60c223 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] No waiting events found dispatching network-vif-plugged-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:40 user nova-compute[74963]: WARNING nova.compute.manager [req-3d260ae2-29bb-4b71-b0ed-b9dae0b1179a req-ea5e77e8-7225-412e-abd5-0be06b60c223 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received unexpected event network-vif-plugged-6644ce62-9413-492a-9550-0969a30b8e50 for instance with vm_state building and task_state spawning.
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:10:41 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Instance spawned successfully.
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:10:41 user nova-compute[74963]: INFO nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:10:41 user nova-compute[74963]: INFO nova.compute.manager [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Took 7.53 seconds to build instance.
Nov 30 08:10:41 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0557fb9-699a-4438-ba7a-ec9ff7ba0d84 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.664s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:41 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Deleted allocations for instance 98e1c4f0-b628-435a-bf98-f814fa927873
Nov 30 08:10:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ac7e0214-7bdd-4ed2-9c6e-e6c28c9d3e80 tempest-TestVolumeSwap-265069428 tempest-TestVolumeSwap-265069428-project-member] Lock "98e1c4f0-b628-435a-bf98-f814fa927873" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.947s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-e4735b3b-db7f-4224-a9ec-6da20a0ca0c6 req-e9f60633-cd3e-49be-b149-35c9d7b02be3 service nova] [instance: 98e1c4f0-b628-435a-bf98-f814fa927873] Received event network-vif-deleted-c3a5ec7a-bdf7-4516-9a9b-2bd4a36e1c00 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:55 user nova-compute[74963]: INFO nova.compute.manager [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Rescuing
Nov 30 08:10:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:10:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquired lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:10:55 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:10:56 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updating instance_info_cache with network_info: [{"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:10:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Releasing lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-8b0c4dc3-1b53-49dd-8796-40194ee8f52a req-ad7f8670-3199-4edc-9522-366c9f394147 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-unplugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8b0c4dc3-1b53-49dd-8796-40194ee8f52a req-ad7f8670-3199-4edc-9522-366c9f394147 service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8b0c4dc3-1b53-49dd-8796-40194ee8f52a req-ad7f8670-3199-4edc-9522-366c9f394147 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8b0c4dc3-1b53-49dd-8796-40194ee8f52a req-ad7f8670-3199-4edc-9522-366c9f394147 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-8b0c4dc3-1b53-49dd-8796-40194ee8f52a req-ad7f8670-3199-4edc-9522-366c9f394147 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-unplugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:57 user nova-compute[74963]: WARNING nova.compute.manager [req-8b0c4dc3-1b53-49dd-8796-40194ee8f52a req-ad7f8670-3199-4edc-9522-366c9f394147 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-unplugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state active and task_state rescuing.
Nov 30 08:10:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Instance destroyed successfully.
Nov 30 08:10:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Attempting a stable device rescue
Nov 30 08:10:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74963) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Instance directory exists: not creating {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 08:10:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Creating image(s)
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "/opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "/opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "/opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'trusted_certs' on Instance uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "95bdaf396ce6de7986c4beccd8a12f495218dbdc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "95bdaf396ce6de7986c4beccd8a12f495218dbdc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc.part --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 1.117s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG nova.virt.images [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] 5d0c0e66-b988-4602-90ad-bd84934c51ed was qcow2, converting to raw {{(pid=74963) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc.part /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc.converted {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-8516108b-ebc8-4dad-b7bd-b574858b5877 req-2c220c22-e1f7-4dfa-bbd1-6103bf18476b service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8516108b-ebc8-4dad-b7bd-b574858b5877 req-2c220c22-e1f7-4dfa-bbd1-6103bf18476b service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8516108b-ebc8-4dad-b7bd-b574858b5877 req-2c220c22-e1f7-4dfa-bbd1-6103bf18476b service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8516108b-ebc8-4dad-b7bd-b574858b5877 req-2c220c22-e1f7-4dfa-bbd1-6103bf18476b service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-8516108b-ebc8-4dad-b7bd-b574858b5877 req-2c220c22-e1f7-4dfa-bbd1-6103bf18476b service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:10:59 user nova-compute[74963]: WARNING nova.compute.manager [req-8516108b-ebc8-4dad-b7bd-b574858b5877 req-2c220c22-e1f7-4dfa-bbd1-6103bf18476b service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state active and task_state rescuing.
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc.part /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc.converted" returned: 0 in 0.351s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc.converted --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc.converted --force-share --output=json" returned: 0 in 0.230s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "95bdaf396ce6de7986c4beccd8a12f495218dbdc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.976s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "95bdaf396ce6de7986c4beccd8a12f495218dbdc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "95bdaf396ce6de7986c4beccd8a12f495218dbdc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:10:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc --force-share --output=json" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc,backing_fmt=raw /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95bdaf396ce6de7986c4beccd8a12f495218dbdc,backing_fmt=raw /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue" returned: 0 in 0.052s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "95bdaf396ce6de7986c4beccd8a12f495218dbdc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'migration_context' on Instance uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<70392773-3fa7-4fb1-8513-9f0391f9e0e0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Start _get_guest_xml network_info=[{"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "vif_mac": "fa:16:3e:68:eb:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5d0c0e66-b988-4602-90ad-bd84934c51ed', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzJfqBWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '70392773-3fa7-4fb1-8513-9f0391f9e0e0', 'attached_at': '', 'detached_at': '', 'volume_id': '959c79f1-2657-4e31-9f80-c2c7f120d46f', 'serial': '959c79f1-2657-4e31-9f80-c2c7f120d46f'}, 'attachment_id': 'c7cba0fc-93cd-45de-988b-dba2ef9b4310', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'resources' on Instance uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<70392773-3fa7-4fb1-8513-9f0391f9e0e0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'numa_topology' on Instance uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<70392773-3fa7-4fb1-8513-9f0391f9e0e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:00 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'vcpu_model' on Instance uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<70392773-3fa7-4fb1-8513-9f0391f9e0e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzJfqBWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:11:00 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:11:00 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:11:00 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f5c313-70e0-4ea0-a3df-e3a0f93d1aa9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jzJfqBWG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 08:11:00 user nova-compute[74963]: node.name = iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:11:00 user nova-compute[74963]: node.tpgt = -1
Nov 30 08:11:00 user nova-compute[74963]: node.startup = automatic
Nov 30 08:11:00 user nova-compute[74963]: node.leading_login = No
Nov 30 08:11:00 user nova-compute[74963]: iface.iscsi_ifacename = default
Nov 30 08:11:00 user nova-compute[74963]: iface.net_ifacename = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.ipaddress = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.prefix_len = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.hwaddress = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.transport_name = tcp
Nov 30 08:11:00 user nova-compute[74963]: iface.initiatorname = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.state = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.vlan_id = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.vlan_priority = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.vlan_state = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.iface_num = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.mtu = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.port = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.bootproto = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.subnet_mask = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.gateway = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.dhcp_alt_client_id = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.dhcp_dns = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.dhcp_learn_iqn = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.dhcp_vendor_id_state = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.dhcp_vendor_id = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.dhcp_slp_da = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.fragmentation = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.gratuitous_arp = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.incoming_forwarding = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.tos_state = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.tos = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.ttl = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.delayed_ack = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.tcp_nagle = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.tcp_wsf_state = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.tcp_wsf = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.tcp_timer_scale = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.tcp_timestamp = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.redirect = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.def_task_mgmt_timeout = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.header_digest = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.data_digest = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.immediate_data = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.initial_r2t = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.data_seq_inorder = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.data_pdu_inorder = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.erl = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.max_receive_data_len = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.first_burst_len = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.max_outstanding_r2t = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.max_burst_len = 0
Nov 30 08:11:00 user nova-compute[74963]: iface.chap_auth = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.bidi_chap = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.strict_login_compliance = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.discovery_auth = <empty>
Nov 30 08:11:00 user nova-compute[74963]: iface.discovery_logout = <empty>
Nov 30 08:11:00 user nova-compute[74963]: node.discovery_address = <empty>
Nov 30 08:11:00 user nova-compute[74963]: node.discovery_port = 0
Nov 30 08:11:00 user nova-compute[74963]: node.discovery_type = static
Nov 30 08:11:00 user nova-compute[74963]: node.session.initial_cmdsn = 0
Nov 30 08:11:00 user nova-compute[74963]: node.session.initial_login_retry_max = 8
Nov 30 08:11:00 user nova-compute[74963]: node.session.xmit_thread_priority = -20
Nov 30 08:11:00 user nova-compute[74963]: node.session.cmds_max = 128
Nov 30 08:11:00 user nova-compute[74963]: node.session.queue_depth = 32
Nov 30 08:11:00 user nova-compute[74963]: node.session.nr_sessions = 1
Nov 30 08:11:00 user nova-compute[74963]: node.session.auth.authmethod = CHAP
Nov 30 08:11:00 user nova-compute[74963]: node.session.auth.username = jzJfqBWG
Nov 30 08:11:00 user nova-compute[74963]: node.session.auth.password = ***
Nov 30 08:11:00 user nova-compute[74963]: node.session.auth.username_in = <empty>
Nov 30 08:11:00 user nova-compute[74963]: node.session.auth.password_in = <empty>
Nov 30 08:11:00 user nova-compute[74963]: node.session.auth.chap_algs = MD5
Nov 30 08:11:00 user nova-compute[74963]: node.session.timeo.replacement_timeout = 120
Nov 30 08:11:00 user nova-compute[74963]: node.session.err_timeo.abort_timeout = 15
Nov 30 08:11:00 user nova-compute[74963]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 08:11:00 user nova-compute[74963]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 08:11:00 user nova-compute[74963]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.FastAbort = Yes
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.InitialR2T = No
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.ImmediateData = Yes
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.MaxConnections = 1
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 08:11:00 user nova-compute[74963]: node.session.iscsi.ERL = 0
Nov 30 08:11:00 user nova-compute[74963]: node.session.scan = manual
Nov 30 08:11:00 user nova-compute[74963]: node.session.reopen_max = 0
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].address = 172.16.0.220
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].port = 3260
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].startup = manual
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].tcp.window_size = 524288
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].tcp.type_of_service = 0
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].timeo.logout_timeout = 15
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].timeo.login_timeout = 15
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].timeo.auth_timeout = 45
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].iscsi.DataDigest = None
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].iscsi.IFMarker = No
Nov 30 08:11:00 user nova-compute[74963]: node.conn[0].iscsi.OFMarker = No
Nov 30 08:11:00 user nova-compute[74963]: # END RECORD
Nov 30 08:11:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca704937-4db1-419f-a330-bf2962451722]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[45095b11-17dd-4ddc-9de0-9da4cfee228b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzJfqBWG {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzJfqBWG" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4967662c-0c24-4380-a519-61c53edd32df]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jzJfqBWG'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bef0350-e00d-4913-baec-bf2b24be06d2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1239f615-a3ca-4109-a4f7-9f99f35b1e7b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:11:00 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:00 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:11:00 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:00 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] HCTL ('35', '0', '0', 0) found on session 11 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e47b562-ce3d-4ed5-9d31-a505bb61b4d9]: (4, ('0 0 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching for a device in session 11 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzJfqBWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '23930656235383731', 'path': '/dev/sdd'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930656235383731', 'path': '/dev/sdd'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074003933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074003933',id=12,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-vnr2mkxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:09:45Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=70392773-3fa7-4fb1-8513-9f0391f9e0e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "vif_mac": "fa:16:3e:68:eb:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "vif_mac": "fa:16:3e:68:eb:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=203987cf-1c90-44b7-9ca1-1eed9597d71a,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203987cf-1c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'pci_devices' on Instance uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.objects.base [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<70392773-3fa7-4fb1-8513-9f0391f9e0e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:11:00 user nova-compute[74963]:   <uuid>70392773-3fa7-4fb1-8513-9f0391f9e0e0</uuid>
Nov 30 08:11:00 user nova-compute[74963]:   <name>instance-0000000c</name>
Nov 30 08:11:00 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:11:00 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:11:00 user nova-compute[74963]:   <metadata>
Nov 30 08:11:00 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:11:00 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:11:00 user nova-compute[74963]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1074003933</nova:name>
Nov 30 08:11:00 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:11:00</nova:creationTime>
Nov 30 08:11:00 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:11:00 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:11:00 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:11:00 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:11:00 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:11:00 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:11:00 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:11:00 user nova-compute[74963]:       <nova:owner>
Nov 30 08:11:00 user nova-compute[74963]:         <nova:user uuid="4b110fcb508342509690b45e1854eb81">tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member</nova:user>
Nov 30 08:11:00 user nova-compute[74963]:         <nova:project uuid="ce233bd757b64de4bd6f6abb3230da01">tempest-ServerBootFromVolumeStableRescueTest-1834985655</nova:project>
Nov 30 08:11:00 user nova-compute[74963]:       </nova:owner>
Nov 30 08:11:00 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:11:00 user nova-compute[74963]:       <nova:ports>
Nov 30 08:11:00 user nova-compute[74963]:         <nova:port uuid="203987cf-1c90-44b7-9ca1-1eed9597d71a">
Nov 30 08:11:00 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 08:11:00 user nova-compute[74963]:         </nova:port>
Nov 30 08:11:00 user nova-compute[74963]:       </nova:ports>
Nov 30 08:11:00 user nova-compute[74963]:     </nova:instance>
Nov 30 08:11:00 user nova-compute[74963]:   </metadata>
Nov 30 08:11:00 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:11:00 user nova-compute[74963]:     <system>
Nov 30 08:11:00 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:11:00 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:11:00 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:11:00 user nova-compute[74963]:       <entry name="serial">70392773-3fa7-4fb1-8513-9f0391f9e0e0</entry>
Nov 30 08:11:00 user nova-compute[74963]:       <entry name="uuid">70392773-3fa7-4fb1-8513-9f0391f9e0e0</entry>
Nov 30 08:11:00 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:11:00 user nova-compute[74963]:     </system>
Nov 30 08:11:00 user nova-compute[74963]:   </sysinfo>
Nov 30 08:11:00 user nova-compute[74963]:   <os>
Nov 30 08:11:00 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:11:00 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:11:00 user nova-compute[74963]:   </os>
Nov 30 08:11:00 user nova-compute[74963]:   <features>
Nov 30 08:11:00 user nova-compute[74963]:     <acpi/>
Nov 30 08:11:00 user nova-compute[74963]:     <apic/>
Nov 30 08:11:00 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:11:00 user nova-compute[74963]:   </features>
Nov 30 08:11:00 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:11:00 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:11:00 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:11:00 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:11:00 user nova-compute[74963]:   </clock>
Nov 30 08:11:00 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:11:00 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:11:00 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:11:00 user nova-compute[74963]:   </cpu>
Nov 30 08:11:00 user nova-compute[74963]:   <devices>
Nov 30 08:11:00 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:11:00 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:11:00 user nova-compute[74963]:       <source dev="/dev/sdd"/>
Nov 30 08:11:00 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:11:00 user nova-compute[74963]:       <serial>959c79f1-2657-4e31-9f80-c2c7f120d46f</serial>
Nov 30 08:11:00 user nova-compute[74963]:     </disk>
Nov 30 08:11:00 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:11:00 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:11:00 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue"/>
Nov 30 08:11:00 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:11:00 user nova-compute[74963]:       <boot order="1"/>
Nov 30 08:11:00 user nova-compute[74963]:     </disk>
Nov 30 08:11:00 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:11:00 user nova-compute[74963]:       <mac address="fa:16:3e:68:eb:73"/>
Nov 30 08:11:00 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:11:00 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:11:00 user nova-compute[74963]:       <target dev="tap203987cf-1c"/>
Nov 30 08:11:00 user nova-compute[74963]:     </interface>
Nov 30 08:11:00 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:11:00 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/console.log" append="off"/>
Nov 30 08:11:00 user nova-compute[74963]:     </serial>
Nov 30 08:11:00 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:11:00 user nova-compute[74963]:     <video>
Nov 30 08:11:00 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:11:00 user nova-compute[74963]:     </video>
Nov 30 08:11:00 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:11:00 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:11:00 user nova-compute[74963]:     </rng>
Nov 30 08:11:00 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:11:00 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:11:00 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:11:00 user nova-compute[74963]:     </memballoon>
Nov 30 08:11:00 user nova-compute[74963]:   </devices>
Nov 30 08:11:00 user nova-compute[74963]: </domain>
Nov 30 08:11:00 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:11:00 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Instance destroyed successfully.
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No VIF found with MAC fa:16:3e:68:eb:73, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "db76a4e1-46a1-4349-a21f-34d43d542349" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8931343a-df3f-4c8f-837b-a052b5dee927 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:11:04 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:04 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:04 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8024MB free_disk=25.533687591552734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:05 user nova-compute[74963]: INFO nova.compute.manager [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Detaching volume 26bbbfc2-6d8b-49fb-b802-f765c1da5f1a
Nov 30 08:11:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Applying migration context for instance 3551893b-4a59-4e6a-a961-8ea6d671632e as it has an incoming, in-progress migration 8bff60fd-3b68-4fc5-916e-ef97635a0749. Migration status is finished {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 08:11:05 user nova-compute[74963]: INFO nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating resource usage from migration 8bff60fd-3b68-4fc5-916e-ef97635a0749
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 25afcf51-de30-4a53-bb6b-3e7037f5e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 67d99f85-78de-4702-aa55-758173230187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Migration 8bff60fd-3b68-4fc5-916e-ef97635a0749 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 3551893b-4a59-4e6a-a961-8ea6d671632e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance bb855029-8201-4c59-a4d2-3fac4a14fec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:11:05 user nova-compute[74963]: INFO nova.virt.block_device [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Attempting to driver detach volume 26bbbfc2-6d8b-49fb-b802-f765c1da5f1a from mountpoint /dev/vdb
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Attempting to detach device vdb from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:11:05 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:11:05 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:11:05 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:11:05 user nova-compute[74963]:   <serial>26bbbfc2-6d8b-49fb-b802-f765c1da5f1a</serial>
Nov 30 08:11:05 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:11:05 user nova-compute[74963]: </disk>
Nov 30 08:11:05 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:11:05 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Successfully detached device vdb from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c from the persistent domain config.
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:11:05 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:11:05 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:11:05 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:11:05 user nova-compute[74963]:   <serial>26bbbfc2-6d8b-49fb-b802-f765c1da5f1a</serial>
Nov 30 08:11:05 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:11:05 user nova-compute[74963]: </disk>
Nov 30 08:11:05 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.793s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.541s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:11:05 user nova-compute[74963]: INFO nova.compute.claims [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Claim successful on node user
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-5b623e5f-6bca-4d04-9654-2b925f383605 req-247dff7a-491d-4c4d-8da4-4e6f64bc88a2 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5b623e5f-6bca-4d04-9654-2b925f383605 req-247dff7a-491d-4c4d-8da4-4e6f64bc88a2 service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5b623e5f-6bca-4d04-9654-2b925f383605 req-247dff7a-491d-4c4d-8da4-4e6f64bc88a2 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5b623e5f-6bca-4d04-9654-2b925f383605 req-247dff7a-491d-4c4d-8da4-4e6f64bc88a2 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-5b623e5f-6bca-4d04-9654-2b925f383605 req-247dff7a-491d-4c4d-8da4-4e6f64bc88a2 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:05 user nova-compute[74963]: WARNING nova.compute.manager [req-5b623e5f-6bca-4d04-9654-2b925f383605 req-247dff7a-491d-4c4d-8da4-4e6f64bc88a2 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state rescued and task_state None.
Nov 30 08:11:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.056s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:11:06 user nova-compute[74963]: INFO nova.compute.claims [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Claim successful on node user
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.network.neutron [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:11:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.policy [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b068a21b7ee04d14984abc97e582aa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d09678c8a049bca20bed732eedd231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:11:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Creating image(s)
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Didn't find any instances for network info cache update. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.224s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.236s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk 1073741824" returned: 0 in 0.233s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.476s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:11:07 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.network.neutron [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Successfully created port: 214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.policy [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b068a21b7ee04d14984abc97e582aa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d09678c8a049bca20bed732eedd231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:11:07 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Creating image(s)
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Cannot resize image /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Ensure instance console log exists: /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.206s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-2601b442-379f-4d9b-9cb7-f67a13f53349 req-716260ef-3818-4584-8409-ca102128aa64 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2601b442-379f-4d9b-9cb7-f67a13f53349 req-716260ef-3818-4584-8409-ca102128aa64 service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2601b442-379f-4d9b-9cb7-f67a13f53349 req-716260ef-3818-4584-8409-ca102128aa64 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2601b442-379f-4d9b-9cb7-f67a13f53349 req-716260ef-3818-4584-8409-ca102128aa64 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-2601b442-379f-4d9b-9cb7-f67a13f53349 req-716260ef-3818-4584-8409-ca102128aa64 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:07 user nova-compute[74963]: WARNING nova.compute.manager [req-2601b442-379f-4d9b-9cb7-f67a13f53349 req-716260ef-3818-4584-8409-ca102128aa64 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state rescued and task_state None.
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk 1073741824" returned: 0 in 0.065s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.219s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Cannot resize image /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Ensure instance console log exists: /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Successfully created port: 8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Successfully updated port: 214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquired lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-ffe076eb-c59a-4bd0-9782-83d4f1849dc6 req-ac4ba61a-6501-41ed-9699-678a89b08a78 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-changed-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-ffe076eb-c59a-4bd0-9782-83d4f1849dc6 req-ac4ba61a-6501-41ed-9699-678a89b08a78 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Refreshing instance network info cache due to event network-changed-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:11:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffe076eb-c59a-4bd0-9782-83d4f1849dc6 req-ac4ba61a-6501-41ed-9699-678a89b08a78 service nova] Acquiring lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updating instance_info_cache with network_info: [{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Releasing lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Instance network_info: |[{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffe076eb-c59a-4bd0-9782-83d4f1849dc6 req-ac4ba61a-6501-41ed-9699-678a89b08a78 service nova] Acquired lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.network.neutron [req-ffe076eb-c59a-4bd0-9782-83d4f1849dc6 req-ac4ba61a-6501-41ed-9699-678a89b08a78 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Refreshing network info cache for port 214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Start _get_guest_xml network_info=[{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:11:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1360927833',display_name='tempest-ServerRescueNegativeTestJSON-server-1360927833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1360927833',id=15,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-0xtpfyjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:11:06Z,user_data=None,user_id='b068a21b7ee04d14984abc97e582aa63',uuid=db76a4e1-46a1-4349-a21f-34d43d542349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b6:0d,bridge_name='br-int',has_traffic_filtering=True,id=214fb252-a1cd-4d60-9439-1a5b9f7e7a0b,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214fb252-a1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.objects.instance [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'pci_devices' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:11:10 user nova-compute[74963]:   <uuid>db76a4e1-46a1-4349-a21f-34d43d542349</uuid>
Nov 30 08:11:10 user nova-compute[74963]:   <name>instance-0000000f</name>
Nov 30 08:11:10 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:11:10 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:11:10 user nova-compute[74963]:   <metadata>
Nov 30 08:11:10 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:11:10 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:11:10 user nova-compute[74963]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1360927833</nova:name>
Nov 30 08:11:10 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:11:10</nova:creationTime>
Nov 30 08:11:10 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:11:10 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:11:10 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:11:10 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:11:10 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:11:10 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:11:10 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:11:10 user nova-compute[74963]:       <nova:owner>
Nov 30 08:11:10 user nova-compute[74963]:         <nova:user uuid="b068a21b7ee04d14984abc97e582aa63">tempest-ServerRescueNegativeTestJSON-1047810333-project-member</nova:user>
Nov 30 08:11:10 user nova-compute[74963]:         <nova:project uuid="c1d09678c8a049bca20bed732eedd231">tempest-ServerRescueNegativeTestJSON-1047810333</nova:project>
Nov 30 08:11:10 user nova-compute[74963]:       </nova:owner>
Nov 30 08:11:10 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:11:10 user nova-compute[74963]:       <nova:ports>
Nov 30 08:11:10 user nova-compute[74963]:         <nova:port uuid="214fb252-a1cd-4d60-9439-1a5b9f7e7a0b">
Nov 30 08:11:10 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 08:11:10 user nova-compute[74963]:         </nova:port>
Nov 30 08:11:10 user nova-compute[74963]:       </nova:ports>
Nov 30 08:11:10 user nova-compute[74963]:     </nova:instance>
Nov 30 08:11:10 user nova-compute[74963]:   </metadata>
Nov 30 08:11:10 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:11:10 user nova-compute[74963]:     <system>
Nov 30 08:11:10 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:11:10 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:11:10 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:11:10 user nova-compute[74963]:       <entry name="serial">db76a4e1-46a1-4349-a21f-34d43d542349</entry>
Nov 30 08:11:10 user nova-compute[74963]:       <entry name="uuid">db76a4e1-46a1-4349-a21f-34d43d542349</entry>
Nov 30 08:11:10 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:11:10 user nova-compute[74963]:     </system>
Nov 30 08:11:10 user nova-compute[74963]:   </sysinfo>
Nov 30 08:11:10 user nova-compute[74963]:   <os>
Nov 30 08:11:10 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:11:10 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:11:10 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:11:10 user nova-compute[74963]:   </os>
Nov 30 08:11:10 user nova-compute[74963]:   <features>
Nov 30 08:11:10 user nova-compute[74963]:     <acpi/>
Nov 30 08:11:10 user nova-compute[74963]:     <apic/>
Nov 30 08:11:10 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:11:10 user nova-compute[74963]:   </features>
Nov 30 08:11:10 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:11:10 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:11:10 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:11:10 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:11:10 user nova-compute[74963]:   </clock>
Nov 30 08:11:10 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:11:10 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:11:10 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:11:10 user nova-compute[74963]:   </cpu>
Nov 30 08:11:10 user nova-compute[74963]:   <devices>
Nov 30 08:11:10 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:11:10 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:11:10 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk"/>
Nov 30 08:11:10 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:11:10 user nova-compute[74963]:     </disk>
Nov 30 08:11:10 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:11:10 user nova-compute[74963]:       <mac address="fa:16:3e:44:b6:0d"/>
Nov 30 08:11:10 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:11:10 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:11:10 user nova-compute[74963]:       <target dev="tap214fb252-a1"/>
Nov 30 08:11:10 user nova-compute[74963]:     </interface>
Nov 30 08:11:10 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:11:10 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/console.log" append="off"/>
Nov 30 08:11:10 user nova-compute[74963]:     </serial>
Nov 30 08:11:10 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:11:10 user nova-compute[74963]:     <video>
Nov 30 08:11:10 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:11:10 user nova-compute[74963]:     </video>
Nov 30 08:11:10 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:11:10 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:11:10 user nova-compute[74963]:     </rng>
Nov 30 08:11:10 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:11:10 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:11:10 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:11:10 user nova-compute[74963]:     </memballoon>
Nov 30 08:11:10 user nova-compute[74963]:   </devices>
Nov 30 08:11:10 user nova-compute[74963]: </domain>
Nov 30 08:11:10 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1360927833',display_name='tempest-ServerRescueNegativeTestJSON-server-1360927833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1360927833',id=15,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-0xtpfyjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:11:06Z,user_data=None,user_id='b068a21b7ee04d14984abc97e582aa63',uuid=db76a4e1-46a1-4349-a21f-34d43d542349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b6:0d,bridge_name='br-int',has_traffic_filtering=True,id=214fb252-a1cd-4d60-9439-1a5b9f7e7a0b,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214fb252-a1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG os_vif [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b6:0d,bridge_name='br-int',has_traffic_filtering=True,id=214fb252-a1cd-4d60-9439-1a5b9f7e7a0b,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214fb252-a1') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e74fa56f-e447-5634-99ea-3ccde35066b1', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap214fb252-a1, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap214fb252-a1, col_values=(('qos', UUID('90326770-9c1f-4e95-be50-92f528f5b249')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap214fb252-a1, col_values=(('external_ids', {'iface-id': '214fb252-a1cd-4d60-9439-1a5b9f7e7a0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:b6:0d', 'vm-uuid': 'db76a4e1-46a1-4349-a21f-34d43d542349'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:10 user nova-compute[74963]: INFO os_vif [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b6:0d,bridge_name='br-int',has_traffic_filtering=True,id=214fb252-a1cd-4d60-9439-1a5b9f7e7a0b,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214fb252-a1')
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No VIF found with MAC fa:16:3e:44:b6:0d, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:10 user nova-compute[74963]: INFO nova.compute.manager [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attaching volume 6f416d06-8893-4a67-9251-43155bfafefd to /dev/vdb
Nov 30 08:11:10 user nova-compute[74963]: DEBUG os_brick.utils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dc9344-7e9e-4b98-a03b-1f195a038da4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Successfully updated port: 8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bb2c71-f19a-4be2-8fcb-e9dc6af0b6c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquired lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c8f2f-8451-465f-b28f-49a7a183ac66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c06c9f-400f-498d-8274-9edcf7df2a99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:11:11 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[134ca06e-0922-49e6-a77d-f04b7fa92422]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG os_brick.utils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating existing volume attachment record: e495907c-00a3-44b4-9ae6-2769b095ed0d {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-ffe076eb-c59a-4bd0-9782-83d4f1849dc6 req-ac4ba61a-6501-41ed-9699-678a89b08a78 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updated VIF entry in instance network info cache for port 214fb252-a1cd-4d60-9439-1a5b9f7e7a0b. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-ffe076eb-c59a-4bd0-9782-83d4f1849dc6 req-ac4ba61a-6501-41ed-9699-678a89b08a78 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updating instance_info_cache with network_info: [{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffe076eb-c59a-4bd0-9782-83d4f1849dc6 req-ac4ba61a-6501-41ed-9699-678a89b08a78 service nova] Releasing lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updating instance_info_cache with network_info: [{"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Releasing lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Instance network_info: |[{"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Start _get_guest_xml network_info=[{"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:11:11 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:11 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1896720287',display_name='tempest-ServerRescueNegativeTestJSON-server-1896720287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1896720287',id=16,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-um1jo7jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:11:07Z,user_data=None,user_id='b068a21b7ee04d14984abc97e582aa63',uuid=e4386623-a0b7-4145-8b84-2a7b64c3a98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dfabd89-d7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:11:11 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'pci_devices' on Instance uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:11:12 user nova-compute[74963]:   <uuid>e4386623-a0b7-4145-8b84-2a7b64c3a98f</uuid>
Nov 30 08:11:12 user nova-compute[74963]:   <name>instance-00000010</name>
Nov 30 08:11:12 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:11:12 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:11:12 user nova-compute[74963]:   <metadata>
Nov 30 08:11:12 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:11:12 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:11:12 user nova-compute[74963]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1896720287</nova:name>
Nov 30 08:11:12 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:11:11</nova:creationTime>
Nov 30 08:11:12 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:11:12 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:11:12 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:11:12 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:11:12 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:11:12 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:11:12 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:11:12 user nova-compute[74963]:       <nova:owner>
Nov 30 08:11:12 user nova-compute[74963]:         <nova:user uuid="b068a21b7ee04d14984abc97e582aa63">tempest-ServerRescueNegativeTestJSON-1047810333-project-member</nova:user>
Nov 30 08:11:12 user nova-compute[74963]:         <nova:project uuid="c1d09678c8a049bca20bed732eedd231">tempest-ServerRescueNegativeTestJSON-1047810333</nova:project>
Nov 30 08:11:12 user nova-compute[74963]:       </nova:owner>
Nov 30 08:11:12 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:11:12 user nova-compute[74963]:       <nova:ports>
Nov 30 08:11:12 user nova-compute[74963]:         <nova:port uuid="8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3">
Nov 30 08:11:12 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 08:11:12 user nova-compute[74963]:         </nova:port>
Nov 30 08:11:12 user nova-compute[74963]:       </nova:ports>
Nov 30 08:11:12 user nova-compute[74963]:     </nova:instance>
Nov 30 08:11:12 user nova-compute[74963]:   </metadata>
Nov 30 08:11:12 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:11:12 user nova-compute[74963]:     <system>
Nov 30 08:11:12 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:11:12 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:11:12 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:11:12 user nova-compute[74963]:       <entry name="serial">e4386623-a0b7-4145-8b84-2a7b64c3a98f</entry>
Nov 30 08:11:12 user nova-compute[74963]:       <entry name="uuid">e4386623-a0b7-4145-8b84-2a7b64c3a98f</entry>
Nov 30 08:11:12 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:11:12 user nova-compute[74963]:     </system>
Nov 30 08:11:12 user nova-compute[74963]:   </sysinfo>
Nov 30 08:11:12 user nova-compute[74963]:   <os>
Nov 30 08:11:12 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:11:12 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:11:12 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:11:12 user nova-compute[74963]:   </os>
Nov 30 08:11:12 user nova-compute[74963]:   <features>
Nov 30 08:11:12 user nova-compute[74963]:     <acpi/>
Nov 30 08:11:12 user nova-compute[74963]:     <apic/>
Nov 30 08:11:12 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:11:12 user nova-compute[74963]:   </features>
Nov 30 08:11:12 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:11:12 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:11:12 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:11:12 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:11:12 user nova-compute[74963]:   </clock>
Nov 30 08:11:12 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:11:12 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:11:12 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:11:12 user nova-compute[74963]:   </cpu>
Nov 30 08:11:12 user nova-compute[74963]:   <devices>
Nov 30 08:11:12 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:11:12 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:11:12 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk"/>
Nov 30 08:11:12 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:11:12 user nova-compute[74963]:     </disk>
Nov 30 08:11:12 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:11:12 user nova-compute[74963]:       <mac address="fa:16:3e:e2:33:a3"/>
Nov 30 08:11:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:11:12 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:11:12 user nova-compute[74963]:       <target dev="tap8dfabd89-d7"/>
Nov 30 08:11:12 user nova-compute[74963]:     </interface>
Nov 30 08:11:12 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:11:12 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/console.log" append="off"/>
Nov 30 08:11:12 user nova-compute[74963]:     </serial>
Nov 30 08:11:12 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:11:12 user nova-compute[74963]:     <video>
Nov 30 08:11:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:11:12 user nova-compute[74963]:     </video>
Nov 30 08:11:12 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:11:12 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:11:12 user nova-compute[74963]:     </rng>
Nov 30 08:11:12 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:11:12 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:11:12 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:11:12 user nova-compute[74963]:     </memballoon>
Nov 30 08:11:12 user nova-compute[74963]:   </devices>
Nov 30 08:11:12 user nova-compute[74963]: </domain>
Nov 30 08:11:12 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1896720287',display_name='tempest-ServerRescueNegativeTestJSON-server-1896720287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1896720287',id=16,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-um1jo7jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:11:07Z,user_data=None,user_id='b068a21b7ee04d14984abc97e582aa63',uuid=e4386623-a0b7-4145-8b84-2a7b64c3a98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dfabd89-d7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG os_vif [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dfabd89-d7') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41e20fdd-6719-5964-b7e2-0584f5aabbb7', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-5df94e5c-f7ad-405a-a0cf-9055e7e85ee5 req-dbd0d971-6c3e-4ef6-a70c-4ba78946cf6a service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-changed-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-5df94e5c-f7ad-405a-a0cf-9055e7e85ee5 req-dbd0d971-6c3e-4ef6-a70c-4ba78946cf6a service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Refreshing instance network info cache due to event network-changed-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5df94e5c-f7ad-405a-a0cf-9055e7e85ee5 req-dbd0d971-6c3e-4ef6-a70c-4ba78946cf6a service nova] Acquiring lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5df94e5c-f7ad-405a-a0cf-9055e7e85ee5 req-dbd0d971-6c3e-4ef6-a70c-4ba78946cf6a service nova] Acquired lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-5df94e5c-f7ad-405a-a0cf-9055e7e85ee5 req-dbd0d971-6c3e-4ef6-a70c-4ba78946cf6a service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Refreshing network info cache for port 8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8dfabd89-d7, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8dfabd89-d7, col_values=(('qos', UUID('ca09e688-9a7f-415f-9e6d-064322837e02')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8dfabd89-d7, col_values=(('external_ids', {'iface-id': '8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:33:a3', 'vm-uuid': 'e4386623-a0b7-4145-8b84-2a7b64c3a98f'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: INFO os_vif [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dfabd89-d7')
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No VIF found with MAC fa:16:3e:e2:33:a3, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "9feae61e-e897-4fa0-b534-157153e8f6c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-5df94e5c-f7ad-405a-a0cf-9055e7e85ee5 req-dbd0d971-6c3e-4ef6-a70c-4ba78946cf6a service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updated VIF entry in instance network info cache for port 8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-5df94e5c-f7ad-405a-a0cf-9055e7e85ee5 req-dbd0d971-6c3e-4ef6-a70c-4ba78946cf6a service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updating instance_info_cache with network_info: [{"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5df94e5c-f7ad-405a-a0cf-9055e7e85ee5 req-dbd0d971-6c3e-4ef6-a70c-4ba78946cf6a service nova] Releasing lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:11:12 user nova-compute[74963]: INFO nova.compute.claims [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Claim successful on node user
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:11:13 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:11:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG nova.policy [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c803479aa87e4be79682975d47b7ccfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22db86fd7a54c5c9882623605de5608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:11:13 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Creating image(s)
Nov 30 08:11:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "/opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "/opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "/opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.202s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.236s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk 1073741824" returned: 0 in 0.069s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-8b6291e1-c129-4fb1-a00a-241c6a0b7f82 req-0777e956-9c1f-42b3-b35e-cf9b63f1cda6 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8b6291e1-c129-4fb1-a00a-241c6a0b7f82 req-0777e956-9c1f-42b3-b35e-cf9b63f1cda6 service nova] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8b6291e1-c129-4fb1-a00a-241c6a0b7f82 req-0777e956-9c1f-42b3-b35e-cf9b63f1cda6 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8b6291e1-c129-4fb1-a00a-241c6a0b7f82 req-0777e956-9c1f-42b3-b35e-cf9b63f1cda6 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-8b6291e1-c129-4fb1-a00a-241c6a0b7f82 req-0777e956-9c1f-42b3-b35e-cf9b63f1cda6 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] No waiting events found dispatching network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:14 user nova-compute[74963]: WARNING nova.compute.manager [req-8b6291e1-c129-4fb1-a00a-241c6a0b7f82 req-0777e956-9c1f-42b3-b35e-cf9b63f1cda6 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received unexpected event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 for instance with vm_state building and task_state spawning.
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.208s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Cannot resize image /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Ensure instance console log exists: /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:14 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Successfully created port: bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Successfully updated port: bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquired lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-e72ade58-bb6d-4956-887f-99dfb60cdcfc req-30fb1370-475a-4f10-9b9a-bfbeffb950c9 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received event network-changed-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-e72ade58-bb6d-4956-887f-99dfb60cdcfc req-30fb1370-475a-4f10-9b9a-bfbeffb950c9 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Refreshing instance network info cache due to event network-changed-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e72ade58-bb6d-4956-887f-99dfb60cdcfc req-30fb1370-475a-4f10-9b9a-bfbeffb950c9 service nova] Acquiring lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.network.neutron [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updating instance_info_cache with network_info: [{"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Releasing lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Instance network_info: |[{"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e72ade58-bb6d-4956-887f-99dfb60cdcfc req-30fb1370-475a-4f10-9b9a-bfbeffb950c9 service nova] Acquired lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-e72ade58-bb6d-4956-887f-99dfb60cdcfc req-30fb1370-475a-4f10-9b9a-bfbeffb950c9 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Refreshing network info cache for port bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Start _get_guest_xml network_info=[{"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:11:15 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:15 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2113163309',display_name='tempest-ServerActionsTestOtherA-server-2113163309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2113163309',id=17,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsWMnq1ufqR++qStn5b43QWm222qTuytohSz8l1/sudpdFVTZkwiTwMp7sHBCXTNfQV4IhtlWVxhMZmDIqgf0oPJwcUspQxqKKVyuXcOkB5qHVJX6ziQnRILaSQcb0Pg==',key_name='tempest-keypair-537501141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-04bdi8vo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=9feae61e-e897-4fa0-b534-157153e8f6c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fb:bc,bridge_name='br-int',has_traffic_filtering=True,id=bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdcb2ee3-67') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.objects.instance [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'pci_devices' on Instance uuid 9feae61e-e897-4fa0-b534-157153e8f6c3 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:11:15 user nova-compute[74963]:   <uuid>9feae61e-e897-4fa0-b534-157153e8f6c3</uuid>
Nov 30 08:11:15 user nova-compute[74963]:   <name>instance-00000011</name>
Nov 30 08:11:15 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:11:15 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:11:15 user nova-compute[74963]:   <metadata>
Nov 30 08:11:15 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:11:15 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:11:15 user nova-compute[74963]:       <nova:name>tempest-ServerActionsTestOtherA-server-2113163309</nova:name>
Nov 30 08:11:15 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:11:15</nova:creationTime>
Nov 30 08:11:15 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:11:15 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:11:15 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:11:15 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:11:15 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:11:15 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:11:15 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:11:15 user nova-compute[74963]:       <nova:owner>
Nov 30 08:11:15 user nova-compute[74963]:         <nova:user uuid="c803479aa87e4be79682975d47b7ccfd">tempest-ServerActionsTestOtherA-768867057-project-member</nova:user>
Nov 30 08:11:15 user nova-compute[74963]:         <nova:project uuid="e22db86fd7a54c5c9882623605de5608">tempest-ServerActionsTestOtherA-768867057</nova:project>
Nov 30 08:11:15 user nova-compute[74963]:       </nova:owner>
Nov 30 08:11:15 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:11:15 user nova-compute[74963]:       <nova:ports>
Nov 30 08:11:15 user nova-compute[74963]:         <nova:port uuid="bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b">
Nov 30 08:11:15 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 08:11:15 user nova-compute[74963]:         </nova:port>
Nov 30 08:11:15 user nova-compute[74963]:       </nova:ports>
Nov 30 08:11:15 user nova-compute[74963]:     </nova:instance>
Nov 30 08:11:15 user nova-compute[74963]:   </metadata>
Nov 30 08:11:15 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:11:15 user nova-compute[74963]:     <system>
Nov 30 08:11:15 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:11:15 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:11:15 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:11:15 user nova-compute[74963]:       <entry name="serial">9feae61e-e897-4fa0-b534-157153e8f6c3</entry>
Nov 30 08:11:15 user nova-compute[74963]:       <entry name="uuid">9feae61e-e897-4fa0-b534-157153e8f6c3</entry>
Nov 30 08:11:15 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:11:15 user nova-compute[74963]:     </system>
Nov 30 08:11:15 user nova-compute[74963]:   </sysinfo>
Nov 30 08:11:15 user nova-compute[74963]:   <os>
Nov 30 08:11:15 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:11:15 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:11:15 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:11:15 user nova-compute[74963]:   </os>
Nov 30 08:11:15 user nova-compute[74963]:   <features>
Nov 30 08:11:15 user nova-compute[74963]:     <acpi/>
Nov 30 08:11:15 user nova-compute[74963]:     <apic/>
Nov 30 08:11:15 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:11:15 user nova-compute[74963]:   </features>
Nov 30 08:11:15 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:11:15 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:11:15 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:11:15 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:11:15 user nova-compute[74963]:   </clock>
Nov 30 08:11:15 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:11:15 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:11:15 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:11:15 user nova-compute[74963]:   </cpu>
Nov 30 08:11:15 user nova-compute[74963]:   <devices>
Nov 30 08:11:15 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:11:15 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:11:15 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk"/>
Nov 30 08:11:15 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:11:15 user nova-compute[74963]:     </disk>
Nov 30 08:11:15 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:11:15 user nova-compute[74963]:       <mac address="fa:16:3e:eb:fb:bc"/>
Nov 30 08:11:15 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:11:15 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:11:15 user nova-compute[74963]:       <target dev="tapbdcb2ee3-67"/>
Nov 30 08:11:15 user nova-compute[74963]:     </interface>
Nov 30 08:11:15 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:11:15 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/console.log" append="off"/>
Nov 30 08:11:15 user nova-compute[74963]:     </serial>
Nov 30 08:11:15 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:11:15 user nova-compute[74963]:     <video>
Nov 30 08:11:15 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:11:15 user nova-compute[74963]:     </video>
Nov 30 08:11:15 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:11:15 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:11:15 user nova-compute[74963]:     </rng>
Nov 30 08:11:15 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:11:15 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:11:15 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:11:15 user nova-compute[74963]:     </memballoon>
Nov 30 08:11:15 user nova-compute[74963]:   </devices>
Nov 30 08:11:15 user nova-compute[74963]: </domain>
Nov 30 08:11:15 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2113163309',display_name='tempest-ServerActionsTestOtherA-server-2113163309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2113163309',id=17,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsWMnq1ufqR++qStn5b43QWm222qTuytohSz8l1/sudpdFVTZkwiTwMp7sHBCXTNfQV4IhtlWVxhMZmDIqgf0oPJwcUspQxqKKVyuXcOkB5qHVJX6ziQnRILaSQcb0Pg==',key_name='tempest-keypair-537501141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-04bdi8vo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=9feae61e-e897-4fa0-b534-157153e8f6c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fb:bc,bridge_name='br-int',has_traffic_filtering=True,id=bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdcb2ee3-67') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG os_vif [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fb:bc,bridge_name='br-int',has_traffic_filtering=True,id=bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdcb2ee3-67') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03722a76-051e-591d-95a2-1294013004ef', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdcb2ee3-67, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbdcb2ee3-67, col_values=(('qos', UUID('68259b3d-f54c-48a5-9c4e-eee1eaa261c7')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbdcb2ee3-67, col_values=(('external_ids', {'iface-id': 'bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:fb:bc', 'vm-uuid': '9feae61e-e897-4fa0-b534-157153e8f6c3'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:11:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Instance spawned successfully.
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:15 user nova-compute[74963]: INFO os_vif [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fb:bc,bridge_name='br-int',has_traffic_filtering=True,id=bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdcb2ee3-67')
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No VIF found with MAC fa:16:3e:eb:fb:bc, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:11:15 user nova-compute[74963]: INFO nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Took 9.53 seconds to spawn the instance on the hypervisor.
Nov 30 08:11:15 user nova-compute[74963]: DEBUG nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:11:16 user nova-compute[74963]: INFO nova.compute.manager [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Took 11.08 seconds to build instance.
Nov 30 08:11:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-daf4e200-1387-42a2-b70d-e51867258643 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "db76a4e1-46a1-4349-a21f-34d43d542349" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.319s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:11:16 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Instance spawned successfully.
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-4c2dc411-8b9c-4175-8913-e5073f64be55 req-df86a60f-af69-462b-9af8-08f8cdf6d89d service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4c2dc411-8b9c-4175-8913-e5073f64be55 req-df86a60f-af69-462b-9af8-08f8cdf6d89d service nova] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4c2dc411-8b9c-4175-8913-e5073f64be55 req-df86a60f-af69-462b-9af8-08f8cdf6d89d service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4c2dc411-8b9c-4175-8913-e5073f64be55 req-df86a60f-af69-462b-9af8-08f8cdf6d89d service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-4c2dc411-8b9c-4175-8913-e5073f64be55 req-df86a60f-af69-462b-9af8-08f8cdf6d89d service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] No waiting events found dispatching network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:16 user nova-compute[74963]: WARNING nova.compute.manager [req-4c2dc411-8b9c-4175-8913-e5073f64be55 req-df86a60f-af69-462b-9af8-08f8cdf6d89d service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received unexpected event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 for instance with vm_state building and task_state spawning.
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:16 user nova-compute[74963]: INFO nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Took 9.06 seconds to spawn the instance on the hypervisor.
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:11:16 user nova-compute[74963]: INFO nova.compute.manager [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Took 11.76 seconds to build instance.
Nov 30 08:11:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ec03711a-506d-4a6d-a41d-1c3f3f29f64f tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.936s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.network.neutron [req-e72ade58-bb6d-4956-887f-99dfb60cdcfc req-30fb1370-475a-4f10-9b9a-bfbeffb950c9 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updated VIF entry in instance network info cache for port bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG nova.network.neutron [req-e72ade58-bb6d-4956-887f-99dfb60cdcfc req-30fb1370-475a-4f10-9b9a-bfbeffb950c9 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updating instance_info_cache with network_info: [{"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:11:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e72ade58-bb6d-4956-887f-99dfb60cdcfc req-30fb1370-475a-4f10-9b9a-bfbeffb950c9 service nova] Releasing lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:17 user nova-compute[74963]: WARNING nova.compute.manager [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state None.
Nov 30 08:11:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:17 user nova-compute[74963]: WARNING nova.compute.manager [req-f72059dd-35f2-4e64-b8ad-7b752f6e341b req-b648ba06-e7e2-4389-b2f4-4e5d46f05e72 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state None.
Nov 30 08:11:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received event network-vif-plugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] Acquiring lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] No waiting events found dispatching network-vif-plugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:19 user nova-compute[74963]: WARNING nova.compute.manager [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received unexpected event network-vif-plugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b for instance with vm_state building and task_state spawning.
Nov 30 08:11:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received event network-vif-plugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] Acquiring lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] No waiting events found dispatching network-vif-plugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:19 user nova-compute[74963]: WARNING nova.compute.manager [req-d352f3ec-ffc4-4d9a-9f90-897f35ebaecf req-88e0c32a-3ed9-4551-8210-f42d6cc31515 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received unexpected event network-vif-plugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b for instance with vm_state building and task_state spawning.
Nov 30 08:11:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:11:20 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Instance spawned successfully.
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:11:20 user nova-compute[74963]: INFO nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Took 6.67 seconds to spawn the instance on the hypervisor.
Nov 30 08:11:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:11:20 user nova-compute[74963]: INFO nova.compute.manager [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Took 7.73 seconds to build instance.
Nov 30 08:11:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-0f855f97-b0c2-41a5-b0f3-497057e87511 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.881s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XfGaixot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:11:21 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:11:21 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:11:21 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa48b8f-bb34-43c7-af03-02e82fd6baec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:11:21 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[23519674-00b1-4190-a3b8-95ff051ca95b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd] added
Nov 30 08:11:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b067ce-c88d-4e7f-874d-91fc66d4c8e9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c3dfff-7538-4d3f-a9b9-4aa6f0f27087]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XfGaixot {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XfGaixot" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3d5155-2c9e-4b83-b513-7627167c7215]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XfGaixot'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b63f34-faf7-4e06-9753-0ae292fba4cf]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf085be-2dc3-4f78-b9b2-04b6ed82968b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3895c558-8a22-45d0-9dd8-721539980180]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd, portal: 172.16.0.220,3260]
Nov 30 08:11:21 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd, portal: 172.16.0.220,3260] successful.
Nov 30 08:11:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db452f9-6b48-40a0-956d-552a08a7dc9e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[757bbb3e-6bc6-446e-b784-91fe415f16dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd (non-flash)
Nov 30 08:11:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:21 user nova-compute[74963]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd (non-flash)
Nov 30 08:11:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[89649050-93dc-4e03-ae07-d6b34cd941ef]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:11:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XfGaixot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:11:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:11:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23635613332623462', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:11:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635613332623462', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:11:22 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:11:22 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:11:22 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:11:22 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:11:22 user nova-compute[74963]:   <serial>6f416d06-8893-4a67-9251-43155bfafefd</serial>
Nov 30 08:11:22 user nova-compute[74963]: </disk>
Nov 30 08:11:22 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:11:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:11:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:11:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No VIF found with MAC fa:16:3e:e2:e7:00, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:11:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e7fde6a0-9000-4b05-a201-670bc38192d9 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.439s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:25 user nova-compute[74963]: INFO nova.compute.manager [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Detaching volume 6f416d06-8893-4a67-9251-43155bfafefd
Nov 30 08:11:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:25 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c is timed out.
Nov 30 08:11:25 user nova-compute[74963]: INFO nova.virt.block_device [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attempting to driver detach volume 6f416d06-8893-4a67-9251-43155bfafefd from mountpoint /dev/vdb
Nov 30 08:11:25 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Successfully detached device vdb from instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c from the live domain config.
Nov 30 08:11:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAMcXVlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:11:25 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:11:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Attempting to detach device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:11:25 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:11:25 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:11:25 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:11:25 user nova-compute[74963]:   <serial>6f416d06-8893-4a67-9251-43155bfafefd</serial>
Nov 30 08:11:25 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:11:25 user nova-compute[74963]: </disk>
Nov 30 08:11:25 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:11:25 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully detached device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the persistent domain config.
Nov 30 08:11:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67d99f85-78de-4702-aa55-758173230187 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:11:25 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:11:25 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:11:25 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:11:25 user nova-compute[74963]:   <serial>6f416d06-8893-4a67-9251-43155bfafefd</serial>
Nov 30 08:11:25 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:11:25 user nova-compute[74963]: </disk>
Nov 30 08:11:25 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0b6208-39f4-4197-8449-0a2b4dcf6e75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:11:25 user nova-compute[74963]: No targets found.
Nov 30 08:11:25 user nova-compute[74963]: iSNS:
Nov 30 08:11:25 user nova-compute[74963]: No targets found.
Nov 30 08:11:25 user nova-compute[74963]: STATIC:
Nov 30 08:11:25 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:11:25 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:11:25 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:11:25 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd
Nov 30 08:11:25 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:11:25 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:11:25 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a
Nov 30 08:11:25 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:11:25 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:11:25 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:11:25 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:11:25 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:11:25 user nova-compute[74963]: FIRMWARE:
Nov 30 08:11:25 user nova-compute[74963]: No targets found.
Nov 30 08:11:25 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:11:25 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:11:25 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6023b5-056c-4b21-bda9-04141067122c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4494e680-63d4-4983-a68f-7e3a5812455a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:11:25 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:25 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:25 user nova-compute[74963]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd (non-flash)
Nov 30 08:11:25 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a (non-flash)
Nov 30 08:11:25 user nova-compute[74963]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:25 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:25 user nova-compute[74963]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd (non-flash)
Nov 30 08:11:25 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:11:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62444a1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a'): ({'sdc'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Removing single pathed devices sdc {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba37bd58-b1bc-48ae-b7a1-f5d5ac4fe0a1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce885d5-5f12-432c-b091-8b81b8bacdb8]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Flushing IO for device /dev/sdc {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6125758b-2159-4096-9935-815d25fd1f82]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcc4a8e-f4d6-43d9-add7-6f05866df21d]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[693df469-2140-43e7-a32e-db4c89b22e54]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b0253d-2cb1-4b46-86d0-9bd974ec82f4]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a, portal: 172.16.0.220,3260]
Nov 30 08:11:26 user nova-compute[74963]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a, portal: 172.16.0.220,3260] successful.
Nov 30 08:11:26 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bbbfc2-6d8b-49fb-b802-f765c1da5f1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d0ea9-82da-4695-9247-86a4ea38f340]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] <== disconnect_volume: return (358ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:11:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:11:27 user nova-compute[74963]: DEBUG nova.objects.instance [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lazy-loading 'flavor' on Instance uuid 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c4cb8b38-0e58-4b9b-b8a9-ecb90bcf3e38 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.534s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:46 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67d99f85-78de-4702-aa55-758173230187 is timed out.
Nov 30 08:11:46 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully detached device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the live domain config.
Nov 30 08:11:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XfGaixot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:11:46 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[079d1064-2265-4ec9-8baa-a53bf658ad74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:11:46 user nova-compute[74963]: No targets found.
Nov 30 08:11:46 user nova-compute[74963]: iSNS:
Nov 30 08:11:46 user nova-compute[74963]: No targets found.
Nov 30 08:11:46 user nova-compute[74963]: STATIC:
Nov 30 08:11:46 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:11:46 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:11:46 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:11:46 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd
Nov 30 08:11:46 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:11:46 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:11:46 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:11:46 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:11:46 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:11:46 user nova-compute[74963]: FIRMWARE:
Nov 30 08:11:46 user nova-compute[74963]: No targets found.
Nov 30 08:11:46 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:11:46 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:11:46 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a662e251-c6e2-43ee-82c9-d76969d0fd07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a13d616-12d2-4226-8cee-52aed5fe7fc7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:46 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:46 user nova-compute[74963]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd (non-flash)
Nov 30 08:11:46 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:11:46 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:11:46 user nova-compute[74963]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd (non-flash)
Nov 30 08:11:46 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624434ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a358d7-c0c0-4755-969e-2ed90819a6ee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad107d3-b3bb-46fd-b36f-7e7d2783aa96]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f502d45c-9494-47cf-bfc0-db81bc3d6f20]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f94f5db-39ed-4ddb-b586-3ec916c89bef]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7eb7f9-008a-488f-a018-38240781bf42]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ace10e9-dbe7-4c85-81d5-ecee974833b2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd, portal: 172.16.0.220,3260]
Nov 30 08:11:46 user nova-compute[74963]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd, portal: 172.16.0.220,3260] successful.
Nov 30 08:11:46 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f416d06-8893-4a67-9251-43155bfafefd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[660217c0-ea4b-46c2-991f-bda641ed7bde]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== disconnect_volume: return (309ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:11:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:11:47 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ff104cae-a46f-458f-80cf-953bc2328205 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.749s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:50 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:55 user nova-compute[74963]: INFO nova.compute.manager [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Terminating instance
Nov 30 08:11:55 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-199ef3c2-0f5d-4d71-8c75-111d8762afb5 req-93bfc375-a48d-4b5b-b0c1-6dd61dd43975 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received event network-vif-unplugged-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-199ef3c2-0f5d-4d71-8c75-111d8762afb5 req-93bfc375-a48d-4b5b-b0c1-6dd61dd43975 service nova] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-199ef3c2-0f5d-4d71-8c75-111d8762afb5 req-93bfc375-a48d-4b5b-b0c1-6dd61dd43975 service nova] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-199ef3c2-0f5d-4d71-8c75-111d8762afb5 req-93bfc375-a48d-4b5b-b0c1-6dd61dd43975 service nova] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-199ef3c2-0f5d-4d71-8c75-111d8762afb5 req-93bfc375-a48d-4b5b-b0c1-6dd61dd43975 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] No waiting events found dispatching network-vif-unplugged-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-199ef3c2-0f5d-4d71-8c75-111d8762afb5 req-93bfc375-a48d-4b5b-b0c1-6dd61dd43975 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received event network-vif-unplugged-50c595ec-df34-4a59-9cce-177d50b6aa06 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:11:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:56 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Instance destroyed successfully.
Nov 30 08:11:56 user nova-compute[74963]: DEBUG nova.objects.instance [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lazy-loading 'resources' on Instance uuid 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1009015824',display_name='tempest-TestServerVolumeAttachmentScenario-server-1009015824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1009015824',id=9,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFCMo0VDl1rnUf5w1XylgQgOovhLpohwS2SsNIdhbGPwZq15OpQsIy6/JRo/bQxZKdVVy1E9XI6BGMMBRWv6XuNqIQ369gjmhyVSMEVWU7Rvq1aQmJeR/0IVBlBaVfOKA==',key_name='tempest-keypair-176192562',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2399f81c098498698d655488b497fa9',ramdisk_id='',reservation_id='r-8hxhqxb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1886977138',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1886977138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:07:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24e41bc83b6c4ef0ae36f1085fa75554',uuid=7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Converting VIF {"id": "50c595ec-df34-4a59-9cce-177d50b6aa06", "address": "fa:16:3e:3b:ec:0f", "network": {"id": "d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1428876052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2399f81c098498698d655488b497fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c595ec-df", "ovs_interfaceid": "50c595ec-df34-4a59-9cce-177d50b6aa06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=50c595ec-df34-4a59-9cce-177d50b6aa06,network=Network(d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c595ec-df') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG os_vif [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=50c595ec-df34-4a59-9cce-177d50b6aa06,network=Network(d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c595ec-df') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50c595ec-df, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ce17b6b-4dfa-456f-aa42-c2fae16bbd2c) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:11:56 user nova-compute[74963]: INFO os_vif [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=50c595ec-df34-4a59-9cce-177d50b6aa06,network=Network(d9763bfa-2b32-4ad5-a4e7-ee09b624ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c595ec-df')
Nov 30 08:11:56 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Deleting instance files /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c_del
Nov 30 08:11:56 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Deletion of /opt/stack/data/nova/instances/7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c_del complete
Nov 30 08:11:56 user nova-compute[74963]: INFO nova.compute.manager [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 30 08:11:56 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:11:56 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:11:57 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Took 0.84 seconds to deallocate network for instance.
Nov 30 08:11:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-c3aae7fb-a265-4638-b6e8-2b836361c657 req-c32ae5d1-23b7-44d8-8416-0b8185055921 service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received event network-vif-deleted-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-4c2cb757-480e-436a-be79-76c10a8f4ff0 req-2af5e00a-666e-4f10-8a70-65657307650a service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received event network-vif-plugged-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4c2cb757-480e-436a-be79-76c10a8f4ff0 req-2af5e00a-666e-4f10-8a70-65657307650a service nova] Acquiring lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4c2cb757-480e-436a-be79-76c10a8f4ff0 req-2af5e00a-666e-4f10-8a70-65657307650a service nova] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4c2cb757-480e-436a-be79-76c10a8f4ff0 req-2af5e00a-666e-4f10-8a70-65657307650a service nova] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-4c2cb757-480e-436a-be79-76c10a8f4ff0 req-2af5e00a-666e-4f10-8a70-65657307650a service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] No waiting events found dispatching network-vif-plugged-50c595ec-df34-4a59-9cce-177d50b6aa06 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:11:57 user nova-compute[74963]: WARNING nova.compute.manager [req-4c2cb757-480e-436a-be79-76c10a8f4ff0 req-2af5e00a-666e-4f10-8a70-65657307650a service nova] [instance: 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c] Received unexpected event network-vif-plugged-50c595ec-df34-4a59-9cce-177d50b6aa06 for instance with vm_state deleted and task_state None.
Nov 30 08:11:57 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:57 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Deleted allocations for instance 7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c7f72fa5-611e-44f6-9ad8-0d792526ca30 tempest-TestServerVolumeAttachmentScenario-1886977138 tempest-TestServerVolumeAttachmentScenario-1886977138-project-member] Lock "7b1956ca-f6ba-4614-a6a6-8c9a2cc7631c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.582s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:11:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:11:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:12:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:01 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:12:01 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7466MB free_disk=25.36370086669922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Applying migration context for instance 3551893b-4a59-4e6a-a961-8ea6d671632e as it has an incoming, in-progress migration 8bff60fd-3b68-4fc5-916e-ef97635a0749. Migration status is finished {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 08:12:01 user nova-compute[74963]: INFO nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating resource usage from migration 8bff60fd-3b68-4fc5-916e-ef97635a0749
Nov 30 08:12:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 25afcf51-de30-4a53-bb6b-3e7037f5e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 67d99f85-78de-4702-aa55-758173230187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Migration 8bff60fd-3b68-4fc5-916e-ef97635a0749 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 3551893b-4a59-4e6a-a961-8ea6d671632e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance bb855029-8201-4c59-a4d2-3fac4a14fec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing inventories for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating ProviderTree inventory for provider 41961ac9-576a-4a02-a5e7-459f54657b3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating inventory in ProviderTree for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing aggregate associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, aggregates: None {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing trait associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] There are 0 instances to clean {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74963) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 08:12:04 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:04 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:04 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:12:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:12:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:12:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:12:04 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:12:04 user nova-compute[74963]: DEBUG nova.objects.instance [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lazy-loading 'info_cache' on Instance uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:12:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG nova.network.neutron [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Port 9f867ffa-aeb8-4693-bce5-c4e507fad1a2 binding to destination host user is already ACTIVE {{(pid=74963) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquired lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG nova.network.neutron [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG nova.network.neutron [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Releasing lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Creating tmpfile /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/tmpzbpnmgm4 to verify with other compute node that the instance is on the same shared storage. {{(pid=74963) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-2fa5f2d3-05c5-401e-81ce-d9be7e1c867c req-5503a01a-88d8-40f4-9dc3-58e293da23cf service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-unplugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2fa5f2d3-05c5-401e-81ce-d9be7e1c867c req-5503a01a-88d8-40f4-9dc3-58e293da23cf service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2fa5f2d3-05c5-401e-81ce-d9be7e1c867c req-5503a01a-88d8-40f4-9dc3-58e293da23cf service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2fa5f2d3-05c5-401e-81ce-d9be7e1c867c req-5503a01a-88d8-40f4-9dc3-58e293da23cf service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-2fa5f2d3-05c5-401e-81ce-d9be7e1c867c req-5503a01a-88d8-40f4-9dc3-58e293da23cf service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-unplugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:09 user nova-compute[74963]: WARNING nova.compute.manager [req-2fa5f2d3-05c5-401e-81ce-d9be7e1c867c req-5503a01a-88d8-40f4-9dc3-58e293da23cf service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-unplugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state resized and task_state resize_reverting.
Nov 30 08:12:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:09 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance destroyed successfully.
Nov 30 08:12:09 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lazy-loading 'resources' on Instance uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1915210269',display_name='tempest-ServerActionsTestOtherB-server-1915210269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1915210269',id=1,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36ci9r8PQsZAIlncqo2lnhzQxOBqtCX/Nhuwzpg/1rHe+dDRDEWc3NXIhEOThN+3uJ2JkTtQ14Ec2v58DN2WowXRvVjxsTkVJ/eZYNznnLTsNFO26FNZYoSoo9gHV1uA==',key_name='tempest-keypair-1061087135',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb3709ed7b39464eb736837ee9167d04',ramdisk_id='',reservation_id='r-ij7puok0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1961924021',owner_user_name='tempest-ServerActionsTestOtherB-1961924021-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='709296ad4feb46a580f22f79a87233b4',uuid=3551893b-4a59-4e6a-a961-8ea6d671632e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converting VIF {"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_vif [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f867ffa-ae, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfe7b211-83dc-4a3b-be68-61cfffb857c0) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:12:09 user nova-compute[74963]: INFO os_vif [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae')
Nov 30 08:12:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:12:09 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e2a580-18b6-4dff-9729-3360d75e44bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:12:09 user nova-compute[74963]: No targets found.
Nov 30 08:12:09 user nova-compute[74963]: iSNS:
Nov 30 08:12:09 user nova-compute[74963]: No targets found.
Nov 30 08:12:09 user nova-compute[74963]: STATIC:
Nov 30 08:12:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:12:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:12:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:12:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:12:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:12:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:12:09 user nova-compute[74963]: FIRMWARE:
Nov 30 08:12:09 user nova-compute[74963]: No targets found.
Nov 30 08:12:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:12:09 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:12:09 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257d8ab-a17b-4fcc-968d-fe8ad1144a6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f899232-f60d-4ebe-89e5-c36a25e56603]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:09 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:09 user nova-compute[74963]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6220798040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036'): ({'sdf'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Removing single pathed devices sdf {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3fc6cc-dd50-492a-b196-6e548d233510]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2301a576-b561-4933-b212-55b35eda3871]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Flushing IO for device /dev/sdf {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa2eb00-5213-4766-b893-23a2e11b9f57]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c586830-9b40-4580-8bd1-6c15a4dddd61]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9205c3-4aec-4e5f-8e22-50960ccb303a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[513809e8-b632-43ea-9d6e-7374b75a2e42]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]
Nov 30 08:12:09 user nova-compute[74963]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.
Nov 30 08:12:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ea9278-ef11-4ef0-973a-48a21c3736bd]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] <== disconnect_volume: return (287ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:12:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:12:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:10 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lazy-loading 'migration_context' on Instance uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:10 user nova-compute[74963]: DEBUG nova.objects.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Object Instance<3551893b-4a59-4e6a-a961-8ea6d671632e> lazy-loaded attributes: resources,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG nova.compute.manager [req-f10401c0-696a-4b58-b757-560d340bdfc8 req-889403ed-312c-4109-8f40-739d218e9304 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f10401c0-696a-4b58-b757-560d340bdfc8 req-889403ed-312c-4109-8f40-739d218e9304 service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f10401c0-696a-4b58-b757-560d340bdfc8 req-889403ed-312c-4109-8f40-739d218e9304 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f10401c0-696a-4b58-b757-560d340bdfc8 req-889403ed-312c-4109-8f40-739d218e9304 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG nova.compute.manager [req-f10401c0-696a-4b58-b757-560d340bdfc8 req-889403ed-312c-4109-8f40-739d218e9304 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:11 user nova-compute[74963]: WARNING nova.compute.manager [req-f10401c0-696a-4b58-b757-560d340bdfc8 req-889403ed-312c-4109-8f40-739d218e9304 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state resized and task_state resize_reverting.
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.435s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:11 user nova-compute[74963]: INFO nova.compute.manager [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Swapping old allocation on dict_keys(['41961ac9-576a-4a02-a5e7-459f54657b3f']) held by migration 8bff60fd-3b68-4fc5-916e-ef97635a0749 for instance
Nov 30 08:12:11 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Overwriting current allocation {'allocations': {'41961ac9-576a-4a02-a5e7-459f54657b3f': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': 'fb3709ed7b39464eb736837ee9167d04', 'user_id': '709296ad4feb46a580f22f79a87233b4', 'consumer_generation': 1} on consumer 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquired lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Releasing lock "refresh_cache-3551893b-4a59-4e6a-a961-8ea6d671632e" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG os_brick.utils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[32841ce1-aebd-48b4-ac58-ff23d0345e76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[52454afc-cc1e-4791-9eea-082c409ca871]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf43b46-903a-4ae8-ab5c-071772b9f2bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae07de1-d37d-45ec-802d-8a9b856903d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:12:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:12:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:12:12 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:12:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[983232f5-4044-4546-b673-e3826b01c04d]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:12:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:12:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:12:12 user nova-compute[74963]: DEBUG os_brick.utils [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:12:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:12:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:12:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:12:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:12:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:12:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:24 user nova-compute[74963]: WARNING nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 68bcb314-8197-4fe6-b986-b2554c822545 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 25afcf51-de30-4a53-bb6b-3e7037f5e386 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid bb855029-8201-4c59-a4d2-3fac4a14fec9 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 9feae61e-e897-4fa0-b534-157153e8f6c3 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:24 user nova-compute[74963]: INFO nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "68bcb314-8197-4fe6-b986-b2554c822545" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "68bcb314-8197-4fe6-b986-b2554c822545" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "25afcf51-de30-4a53-bb6b-3e7037f5e386" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "db76a4e1-46a1-4349-a21f-34d43d542349" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "9feae61e-e897-4fa0-b534-157153e8f6c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "68bcb314-8197-4fe6-b986-b2554c822545" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "db76a4e1-46a1-4349-a21f-34d43d542349" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-9b65b493-2006-47ff-8746-3847a4ade110 req-276fd36c-2e3d-4a75-8128-84446727ed9f service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received event network-changed-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-9b65b493-2006-47ff-8746-3847a4ade110 req-276fd36c-2e3d-4a75-8128-84446727ed9f service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Refreshing instance network info cache due to event network-changed-6644ce62-9413-492a-9550-0969a30b8e50. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9b65b493-2006-47ff-8746-3847a4ade110 req-276fd36c-2e3d-4a75-8128-84446727ed9f service nova] Acquiring lock "refresh_cache-bb855029-8201-4c59-a4d2-3fac4a14fec9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9b65b493-2006-47ff-8746-3847a4ade110 req-276fd36c-2e3d-4a75-8128-84446727ed9f service nova] Acquired lock "refresh_cache-bb855029-8201-4c59-a4d2-3fac4a14fec9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:12:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-9b65b493-2006-47ff-8746-3847a4ade110 req-276fd36c-2e3d-4a75-8128-84446727ed9f service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Refreshing network info cache for port 6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:25 user nova-compute[74963]: INFO nova.compute.manager [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attaching volume b3615a2a-3b12-408d-8a5a-bb5be875b5c1 to /dev/vdb
Nov 30 08:12:25 user nova-compute[74963]: DEBUG os_brick.utils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4b9613-8551-4fea-a1ed-1fec8cd87e11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8e5b99-f16c-4ad7-b0ac-870e5a730772]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e5c61d-bf23-4d14-811a-ae3533603ed3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b60bbf-539c-428d-97bf-ab361689ea7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:12:25 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9178fd-cf7b-43ef-9c41-3538d503be8d]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG os_brick.utils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating existing volume attachment record: 87ea284b-ca66-4bd9-9ee9-44c4e0205a25 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG nova.network.neutron [req-9b65b493-2006-47ff-8746-3847a4ade110 req-276fd36c-2e3d-4a75-8128-84446727ed9f service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Updated VIF entry in instance network info cache for port 6644ce62-9413-492a-9550-0969a30b8e50. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG nova.network.neutron [req-9b65b493-2006-47ff-8746-3847a4ade110 req-276fd36c-2e3d-4a75-8128-84446727ed9f service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Updating instance_info_cache with network_info: [{"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:12:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9b65b493-2006-47ff-8746-3847a4ade110 req-276fd36c-2e3d-4a75-8128-84446727ed9f service nova] Releasing lock "refresh_cache-bb855029-8201-4c59-a4d2-3fac4a14fec9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Starting finish_revert_migration {{(pid=74963) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Start _get_guest_xml network_info=[{"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3551893b-4a59-4e6a-a961-8ea6d671632e', 'attached_at': '2023-11-30T08:12:28.000000', 'detached_at': '', 'volume_id': '0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'serial': '0705d8a6-7d88-49a3-b0c9-341d67e1c036'}, 'attachment_id': 'f428c216-047d-4f3a-b4e0-3b65001029dd', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:12:28 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:12:28 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:12:28 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:12:28 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:12:28 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a08a3b-b076-405f-9137-1fb244c5e362]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:12:28 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb360fe-83d1-4a84-9acc-30b2533529d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036] added
Nov 30 08:12:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[79140d99-5a77-41b7-989e-4757faf04b6b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34a570e-b924-4d56-a8b3-6bc1504b2f70]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzlsTFwc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzlsTFwc" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3682c25d-0ca4-46de-af90-596e93e9aeb2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yzlsTFwc'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3307e3fb-9ed7-4564-85e1-71574cf8ab98]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.objects.instance [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lazy-loading 'flavor' on Instance uuid bb855029-8201-4c59-a4d2-3fac4a14fec9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d04776-a62d-40b3-a8fb-eaa2c89af147]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66db8fd-4454-4a14-a08e-4b33d938b509]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]
Nov 30 08:12:28 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.
Nov 30 08:12:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[588e3916-953c-4691-b836-157d4593240b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3372232-09ac-4eb5-8da8-10a37bed4e69]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:28 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:28 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:28 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ff622-ded8-457f-bd1a-47ce1f911b71]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:28 user nova-compute[74963]: INFO nova.compute.manager [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Attaching volume 5ed3302a-dc62-4909-9fbb-ec6250b0249f to /dev/vdb
Nov 30 08:12:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.utils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b1f7f0-60eb-4466-bdd6-978fcb4c7da4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba1d925-a602-4213-a24e-4f908c806237]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd60d60-5f79-45ba-9700-fc44a57383ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b84a6c0-30d0-44bd-9240-66250437dc43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:12:28 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:12:28 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[614f6568-12c5-4ef6-ad15-96314ba3876e]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG os_brick.utils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:12:28 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Updating existing volume attachment record: f664aa64-ba24-4828-ac2e-75274f57165d {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23337653934356136', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337653934356136', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1915210269',display_name='tempest-ServerActionsTestOtherB-server-1915210269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1915210269',id=1,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36ci9r8PQsZAIlncqo2lnhzQxOBqtCX/Nhuwzpg/1rHe+dDRDEWc3NXIhEOThN+3uJ2JkTtQ14Ec2v58DN2WowXRvVjxsTkVJ/eZYNznnLTsNFO26FNZYoSoo9gHV1uA==',key_name='tempest-keypair-1061087135',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb3709ed7b39464eb736837ee9167d04',ramdisk_id='',reservation_id='r-ij7puok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1961924021',owner_user_name='tempest-ServerActionsTestOtherB-1961924021-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='709296ad4feb46a580f22f79a87233b4',uuid=3551893b-4a59-4e6a-a961-8ea6d671632e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converting VIF {"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:12:29 user nova-compute[74963]:   <uuid>3551893b-4a59-4e6a-a961-8ea6d671632e</uuid>
Nov 30 08:12:29 user nova-compute[74963]:   <name>instance-00000001</name>
Nov 30 08:12:29 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:12:29 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:12:29 user nova-compute[74963]:   <metadata>
Nov 30 08:12:29 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:12:29 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:12:29 user nova-compute[74963]:       <nova:name>tempest-ServerActionsTestOtherB-server-1915210269</nova:name>
Nov 30 08:12:29 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:12:28</nova:creationTime>
Nov 30 08:12:29 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:12:29 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:12:29 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:12:29 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:12:29 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:12:29 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:12:29 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:12:29 user nova-compute[74963]:       <nova:owner>
Nov 30 08:12:29 user nova-compute[74963]:         <nova:user uuid="709296ad4feb46a580f22f79a87233b4">tempest-ServerActionsTestOtherB-1961924021-project-member</nova:user>
Nov 30 08:12:29 user nova-compute[74963]:         <nova:project uuid="fb3709ed7b39464eb736837ee9167d04">tempest-ServerActionsTestOtherB-1961924021</nova:project>
Nov 30 08:12:29 user nova-compute[74963]:       </nova:owner>
Nov 30 08:12:29 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:12:29 user nova-compute[74963]:       <nova:ports>
Nov 30 08:12:29 user nova-compute[74963]:         <nova:port uuid="9f867ffa-aeb8-4693-bce5-c4e507fad1a2">
Nov 30 08:12:29 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 08:12:29 user nova-compute[74963]:         </nova:port>
Nov 30 08:12:29 user nova-compute[74963]:       </nova:ports>
Nov 30 08:12:29 user nova-compute[74963]:     </nova:instance>
Nov 30 08:12:29 user nova-compute[74963]:   </metadata>
Nov 30 08:12:29 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:12:29 user nova-compute[74963]:     <system>
Nov 30 08:12:29 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:12:29 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:12:29 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:12:29 user nova-compute[74963]:       <entry name="serial">3551893b-4a59-4e6a-a961-8ea6d671632e</entry>
Nov 30 08:12:29 user nova-compute[74963]:       <entry name="uuid">3551893b-4a59-4e6a-a961-8ea6d671632e</entry>
Nov 30 08:12:29 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:12:29 user nova-compute[74963]:     </system>
Nov 30 08:12:29 user nova-compute[74963]:   </sysinfo>
Nov 30 08:12:29 user nova-compute[74963]:   <os>
Nov 30 08:12:29 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:12:29 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:12:29 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:12:29 user nova-compute[74963]:   </os>
Nov 30 08:12:29 user nova-compute[74963]:   <features>
Nov 30 08:12:29 user nova-compute[74963]:     <acpi/>
Nov 30 08:12:29 user nova-compute[74963]:     <apic/>
Nov 30 08:12:29 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:12:29 user nova-compute[74963]:   </features>
Nov 30 08:12:29 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:12:29 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:12:29 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:12:29 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:12:29 user nova-compute[74963]:   </clock>
Nov 30 08:12:29 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:12:29 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:12:29 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:12:29 user nova-compute[74963]:   </cpu>
Nov 30 08:12:29 user nova-compute[74963]:   <devices>
Nov 30 08:12:29 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:12:29 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:12:29 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk"/>
Nov 30 08:12:29 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:12:29 user nova-compute[74963]:     </disk>
Nov 30 08:12:29 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:12:29 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:12:29 user nova-compute[74963]:       <source dev="/dev/sdb"/>
Nov 30 08:12:29 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:12:29 user nova-compute[74963]:       <serial>0705d8a6-7d88-49a3-b0c9-341d67e1c036</serial>
Nov 30 08:12:29 user nova-compute[74963]:     </disk>
Nov 30 08:12:29 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:12:29 user nova-compute[74963]:       <mac address="fa:16:3e:35:ea:ab"/>
Nov 30 08:12:29 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:12:29 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:12:29 user nova-compute[74963]:       <target dev="tap9f867ffa-ae"/>
Nov 30 08:12:29 user nova-compute[74963]:     </interface>
Nov 30 08:12:29 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:12:29 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/console.log" append="off"/>
Nov 30 08:12:29 user nova-compute[74963]:     </serial>
Nov 30 08:12:29 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:12:29 user nova-compute[74963]:     <video>
Nov 30 08:12:29 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:12:29 user nova-compute[74963]:     </video>
Nov 30 08:12:29 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:12:29 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:12:29 user nova-compute[74963]:     </rng>
Nov 30 08:12:29 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:12:29 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:12:29 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:12:29 user nova-compute[74963]:     </memballoon>
Nov 30 08:12:29 user nova-compute[74963]:   </devices>
Nov 30 08:12:29 user nova-compute[74963]: </domain>
Nov 30 08:12:29 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1915210269',display_name='tempest-ServerActionsTestOtherB-server-1915210269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1915210269',id=1,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36ci9r8PQsZAIlncqo2lnhzQxOBqtCX/Nhuwzpg/1rHe+dDRDEWc3NXIhEOThN+3uJ2JkTtQ14Ec2v58DN2WowXRvVjxsTkVJ/eZYNznnLTsNFO26FNZYoSoo9gHV1uA==',key_name='tempest-keypair-1061087135',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb3709ed7b39464eb736837ee9167d04',ramdisk_id='',reservation_id='r-ij7puok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1961924021',owner_user_name='tempest-ServerActionsTestOtherB-1961924021-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='709296ad4feb46a580f22f79a87233b4',uuid=3551893b-4a59-4e6a-a961-8ea6d671632e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converting VIF {"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG os_vif [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b887bd5e-e847-5e94-90fa-ec02966b888b', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f867ffa-ae, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f867ffa-ae, col_values=(('qos', UUID('ae3092a7-df22-4864-ae79-1488ce72dc14')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f867ffa-ae, col_values=(('external_ids', {'iface-id': '9f867ffa-aeb8-4693-bce5-c4e507fad1a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:ea:ab', 'vm-uuid': '3551893b-4a59-4e6a-a961-8ea6d671632e'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:12:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:29 user nova-compute[74963]: INFO os_vif [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae')
Nov 30 08:12:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:31 user nova-compute[74963]: DEBUG nova.compute.manager [req-44aa10ee-7767-4c30-91ea-b7cbc848720e req-f3caaeab-e76d-48c1-979f-7abb9a7ac417 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-44aa10ee-7767-4c30-91ea-b7cbc848720e req-f3caaeab-e76d-48c1-979f-7abb9a7ac417 service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-44aa10ee-7767-4c30-91ea-b7cbc848720e req-f3caaeab-e76d-48c1-979f-7abb9a7ac417 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-44aa10ee-7767-4c30-91ea-b7cbc848720e req-f3caaeab-e76d-48c1-979f-7abb9a7ac417 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:31 user nova-compute[74963]: DEBUG nova.compute.manager [req-44aa10ee-7767-4c30-91ea-b7cbc848720e req-f3caaeab-e76d-48c1-979f-7abb9a7ac417 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:31 user nova-compute[74963]: WARNING nova.compute.manager [req-44aa10ee-7767-4c30-91ea-b7cbc848720e req-f3caaeab-e76d-48c1-979f-7abb9a7ac417 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state resized and task_state resize_reverting.
Nov 30 08:12:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:12:33 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance running successfully.
Nov 30 08:12:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] finish_revert_migration finished successfully. {{(pid=74963) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 30 08:12:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-ddb0091d-3273-47a7-8981-e786be67611c req-adf35747-79be-43ee-9c2c-dff69565b25d service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ddb0091d-3273-47a7-8981-e786be67611c req-adf35747-79be-43ee-9c2c-dff69565b25d service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ddb0091d-3273-47a7-8981-e786be67611c req-adf35747-79be-43ee-9c2c-dff69565b25d service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ddb0091d-3273-47a7-8981-e786be67611c req-adf35747-79be-43ee-9c2c-dff69565b25d service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-ddb0091d-3273-47a7-8981-e786be67611c req-adf35747-79be-43ee-9c2c-dff69565b25d service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:33 user nova-compute[74963]: WARNING nova.compute.manager [req-ddb0091d-3273-47a7-8981-e786be67611c req-adf35747-79be-43ee-9c2c-dff69565b25d service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state resized and task_state resize_reverting.
Nov 30 08:12:33 user nova-compute[74963]: INFO nova.compute.manager [None req-a0495eb9-51b9-45e5-b0ef-dcef7f1774dc tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance to original state: 'active'
Nov 30 08:12:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:12:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:46 user nova-compute[74963]: INFO nova.compute.manager [None req-84055079-86ee-40bb-8e76-30c137a1cdf2 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Unrescuing
Nov 30 08:12:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84055079-86ee-40bb-8e76-30c137a1cdf2 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:12:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84055079-86ee-40bb-8e76-30c137a1cdf2 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquired lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:12:46 user nova-compute[74963]: DEBUG nova.network.neutron [None req-84055079-86ee-40bb-8e76-30c137a1cdf2 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:12:46 user nova-compute[74963]: DEBUG nova.network.neutron [None req-84055079-86ee-40bb-8e76-30c137a1cdf2 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updating instance_info_cache with network_info: [{"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:12:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84055079-86ee-40bb-8e76-30c137a1cdf2 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Releasing lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:12:46 user nova-compute[74963]: DEBUG nova.objects.instance [None req-84055079-86ee-40bb-8e76-30c137a1cdf2 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'flavor' on Instance uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-37a3ce12-c25c-417d-9b35-65fe49a73760 req-d8c2077c-3cae-49bb-b77d-c5c887bd226a service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-unplugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-37a3ce12-c25c-417d-9b35-65fe49a73760 req-d8c2077c-3cae-49bb-b77d-c5c887bd226a service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-37a3ce12-c25c-417d-9b35-65fe49a73760 req-d8c2077c-3cae-49bb-b77d-c5c887bd226a service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-37a3ce12-c25c-417d-9b35-65fe49a73760 req-d8c2077c-3cae-49bb-b77d-c5c887bd226a service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-37a3ce12-c25c-417d-9b35-65fe49a73760 req-d8c2077c-3cae-49bb-b77d-c5c887bd226a service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-unplugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:47 user nova-compute[74963]: WARNING nova.compute.manager [req-37a3ce12-c25c-417d-9b35-65fe49a73760 req-d8c2077c-3cae-49bb-b77d-c5c887bd226a service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-unplugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:12:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:47 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Instance destroyed successfully.
Nov 30 08:12:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:49 user nova-compute[74963]: WARNING nova.compute.manager [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:12:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:49 user nova-compute[74963]: WARNING nova.compute.manager [req-e9cde63e-7147-4abf-80e9-9476f8791bae req-d13caeda-db3d-42f3-b055-4af7c9e6c5af service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:12:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHgLyZWI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:12:49 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:12:49 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:12:49 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe034fd-c433-490e-8a26-2330f0b40c81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:12:49 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b5e14c-0f86-4756-b360-45436d71c06d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1] added
Nov 30 08:12:49 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irjvGOJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:12:49 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb6d56e-7998-4f81-8d73-4a6ce04467f1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1650c52f-673e-49f1-9d3a-b154c1a14afe]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHgLyZWI {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHgLyZWI" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef7c006-4ff5-4610-86df-079127c55bd9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BHgLyZWI'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[320a70c7-aecd-4d89-916d-661171dc1a12]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d2f09b-7c92-486b-927c-a87eda62faa9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:49 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:49 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:49 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:49 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993636e-40b5-4baa-9bcc-9b4e16724255]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1, portal: 172.16.0.220,3260]
Nov 30 08:12:49 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1, portal: 172.16.0.220,3260] successful.
Nov 30 08:12:49 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e2928b-1186-481c-ab5e-73fb05b2aba2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a41e4e-44c6-4c59-b224-d0149a5937f7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:49 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:49 user nova-compute[74963]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)
Nov 30 08:12:49 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:49 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:49 user nova-compute[74963]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)
Nov 30 08:12:49 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ef71ab-887a-4ec7-a547-d0aaa3d44cda]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:12:49 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHgLyZWI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26337316338356362', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337316338356362', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.268s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:12:50 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:12:50 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b58c6b0-b000-4351-b3bf-a75e7d641c99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:12:50 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:12:50 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:12:50 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:12:50 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:12:50 user nova-compute[74963]:   <serial>b3615a2a-3b12-408d-8a5a-bb5be875b5c1</serial>
Nov 30 08:12:50 user nova-compute[74963]: </disk>
Nov 30 08:12:50 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4666609a-7401-4819-950e-3254f219f7cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f] added
Nov 30 08:12:50 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56fef0f-6995-4817-a139-8b10839c29f1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79e1fe4-34ba-4402-8d5c-ca47d6231197]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irjvGOJn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irjvGOJn" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4ad090-4584-4dc9-90d3-4226638062bb]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'irjvGOJn'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c9c184-8b53-4c6b-b461-693d2e593fd8]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6fb7f0-1a9d-47c8-9f26-b8ad7fb6dcde]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)
Nov 30 08:12:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)
Nov 30 08:12:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86b9c71-bcaa-424e-aa5a-4e7bb6fd0305]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f, portal: 172.16.0.220,3260]
Nov 30 08:12:51 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f, portal: 172.16.0.220,3260] successful.
Nov 30 08:12:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5527f4be-b939-43a5-a0e4-b07db8ed8c83]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[371d9d43-d00c-4e2c-a97a-f24991e9b7f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f (non-flash)
Nov 30 08:12:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)
Nov 30 08:12:51 user nova-compute[74963]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f (non-flash)
Nov 30 08:12:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-84055079-86ee-40bb-8e76-30c137a1cdf2 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f12962-8d1f-4ba4-ac71-5d3972ec493d]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irjvGOJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No VIF found with MAC fa:16:3e:e2:e7:00, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-f4eafb61-ef59-4c6a-ab4f-afacf9f987f8 req-545ad6c3-7330-4a5c-b834-2ac01e2b62f1 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f4eafb61-ef59-4c6a-ab4f-afacf9f987f8 req-545ad6c3-7330-4a5c-b834-2ac01e2b62f1 service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f4eafb61-ef59-4c6a-ab4f-afacf9f987f8 req-545ad6c3-7330-4a5c-b834-2ac01e2b62f1 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f4eafb61-ef59-4c6a-ab4f-afacf9f987f8 req-545ad6c3-7330-4a5c-b834-2ac01e2b62f1 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-f4eafb61-ef59-4c6a-ab4f-afacf9f987f8 req-545ad6c3-7330-4a5c-b834-2ac01e2b62f1 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:51 user nova-compute[74963]: WARNING nova.compute.manager [req-f4eafb61-ef59-4c6a-ab4f-afacf9f987f8 req-545ad6c3-7330-4a5c-b834-2ac01e2b62f1 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state active and task_state None.
Nov 30 08:12:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e09805f8-2c10-4d94-afb9-8f423c0e26af tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.174s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:12:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] <== connect_volume: return (2585ms) {'type': 'block', 'scsi_wwn': '23337336361316431', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:12:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337336361316431', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:12:52 user nova-compute[74963]: DEBUG nova.objects.instance [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lazy-loading 'flavor' on Instance uuid bb855029-8201-4c59-a4d2-3fac4a14fec9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:12:52 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:12:52 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:12:52 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:12:52 user nova-compute[74963]:   <serial>5ed3302a-dc62-4909-9fbb-ec6250b0249f</serial>
Nov 30 08:12:52 user nova-compute[74963]: </disk>
Nov 30 08:12:52 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:12:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:12:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:12:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] No VIF found with MAC fa:16:3e:46:bc:97, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:12:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c5755f2d-bdb2-4f4e-84dd-2d2c352b00c6 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.159s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:53 user nova-compute[74963]: INFO nova.compute.manager [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Rescuing
Nov 30 08:12:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquired lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:53 user nova-compute[74963]: INFO nova.compute.manager [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Detaching volume b3615a2a-3b12-408d-8a5a-bb5be875b5c1
Nov 30 08:12:53 user nova-compute[74963]: INFO nova.virt.block_device [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attempting to driver detach volume b3615a2a-3b12-408d-8a5a-bb5be875b5c1 from mountpoint /dev/vdb
Nov 30 08:12:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Attempting to detach device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:12:53 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:12:53 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:12:53 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:12:53 user nova-compute[74963]:   <serial>b3615a2a-3b12-408d-8a5a-bb5be875b5c1</serial>
Nov 30 08:12:53 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:12:53 user nova-compute[74963]: </disk>
Nov 30 08:12:53 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:12:53 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully detached device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the persistent domain config.
Nov 30 08:12:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67d99f85-78de-4702-aa55-758173230187 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:12:53 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:12:53 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:12:53 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:12:53 user nova-compute[74963]:   <serial>b3615a2a-3b12-408d-8a5a-bb5be875b5c1</serial>
Nov 30 08:12:53 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:12:53 user nova-compute[74963]: </disk>
Nov 30 08:12:53 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updating instance_info_cache with network_info: [{"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Releasing lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-721d1942-8619-4ec1-9dfe-64182541f902 req-36c0571e-565a-49d5-8b45-432de06b7d52 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-unplugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-721d1942-8619-4ec1-9dfe-64182541f902 req-36c0571e-565a-49d5-8b45-432de06b7d52 service nova] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-721d1942-8619-4ec1-9dfe-64182541f902 req-36c0571e-565a-49d5-8b45-432de06b7d52 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-721d1942-8619-4ec1-9dfe-64182541f902 req-36c0571e-565a-49d5-8b45-432de06b7d52 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-721d1942-8619-4ec1-9dfe-64182541f902 req-36c0571e-565a-49d5-8b45-432de06b7d52 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] No waiting events found dispatching network-vif-unplugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:54 user nova-compute[74963]: WARNING nova.compute.manager [req-721d1942-8619-4ec1-9dfe-64182541f902 req-36c0571e-565a-49d5-8b45-432de06b7d52 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received unexpected event network-vif-unplugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 for instance with vm_state active and task_state rescuing.
Nov 30 08:12:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:54 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Instance destroyed successfully.
Nov 30 08:12:54 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Attempting rescue
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74963) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Instance directory exists: not creating {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 08:12:54 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Creating image(s)
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:54 user nova-compute[74963]: INFO nova.compute.manager [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Detaching volume 5ed3302a-dc62-4909-9fbb-ec6250b0249f
Nov 30 08:12:54 user nova-compute[74963]: INFO nova.virt.block_device [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Attempting to driver detach volume 5ed3302a-dc62-4909-9fbb-ec6250b0249f from mountpoint /dev/vdb
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Attempting to detach device vdb from instance bb855029-8201-4c59-a4d2-3fac4a14fec9 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:12:54 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:12:54 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:12:54 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:12:54 user nova-compute[74963]:   <serial>5ed3302a-dc62-4909-9fbb-ec6250b0249f</serial>
Nov 30 08:12:54 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:12:54 user nova-compute[74963]: </disk>
Nov 30 08:12:54 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.213s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:54 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Successfully detached device vdb from instance bb855029-8201-4c59-a4d2-3fac4a14fec9 from the persistent domain config.
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb855029-8201-4c59-a4d2-3fac4a14fec9 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:12:54 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:12:54 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:12:54 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:12:54 user nova-compute[74963]:   <serial>5ed3302a-dc62-4909-9fbb-ec6250b0249f</serial>
Nov 30 08:12:54 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:12:54 user nova-compute[74963]: </disk>
Nov 30 08:12:54 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue" returned: 0 in 0.052s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'migration_context' on Instance uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.base [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<e4386623-a0b7-4145-8b84-2a7b64c3a98f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Start _get_guest_xml network_info=[{"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "vif_mac": "fa:16:3e:e2:33:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'resources' on Instance uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.base [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<e4386623-a0b7-4145-8b84-2a7b64c3a98f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'numa_topology' on Instance uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.base [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<e4386623-a0b7-4145-8b84-2a7b64c3a98f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:12:54 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:12:54 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.base [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<e4386623-a0b7-4145-8b84-2a7b64c3a98f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1896720287',display_name='tempest-ServerRescueNegativeTestJSON-server-1896720287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1896720287',id=16,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:11:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-um1jo7jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:11:17Z,user_data=None,user_id='b068a21b7ee04d14984abc97e582aa63',uuid=e4386623-a0b7-4145-8b84-2a7b64c3a98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "vif_mac": "fa:16:3e:e2:33:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "vif_mac": "fa:16:3e:e2:33:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dfabd89-d7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'pci_devices' on Instance uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.objects.base [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<e4386623-a0b7-4145-8b84-2a7b64c3a98f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:12:54 user nova-compute[74963]:   <uuid>e4386623-a0b7-4145-8b84-2a7b64c3a98f</uuid>
Nov 30 08:12:54 user nova-compute[74963]:   <name>instance-00000010</name>
Nov 30 08:12:54 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:12:54 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:12:54 user nova-compute[74963]:   <metadata>
Nov 30 08:12:54 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:12:54 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:12:54 user nova-compute[74963]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1896720287</nova:name>
Nov 30 08:12:54 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:12:54</nova:creationTime>
Nov 30 08:12:54 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:12:54 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:12:54 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:12:54 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:12:54 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:12:54 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:12:54 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:12:54 user nova-compute[74963]:       <nova:owner>
Nov 30 08:12:54 user nova-compute[74963]:         <nova:user uuid="b068a21b7ee04d14984abc97e582aa63">tempest-ServerRescueNegativeTestJSON-1047810333-project-member</nova:user>
Nov 30 08:12:54 user nova-compute[74963]:         <nova:project uuid="c1d09678c8a049bca20bed732eedd231">tempest-ServerRescueNegativeTestJSON-1047810333</nova:project>
Nov 30 08:12:54 user nova-compute[74963]:       </nova:owner>
Nov 30 08:12:54 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:12:54 user nova-compute[74963]:       <nova:ports>
Nov 30 08:12:54 user nova-compute[74963]:         <nova:port uuid="8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3">
Nov 30 08:12:54 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 08:12:54 user nova-compute[74963]:         </nova:port>
Nov 30 08:12:54 user nova-compute[74963]:       </nova:ports>
Nov 30 08:12:54 user nova-compute[74963]:     </nova:instance>
Nov 30 08:12:54 user nova-compute[74963]:   </metadata>
Nov 30 08:12:54 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:12:54 user nova-compute[74963]:     <system>
Nov 30 08:12:54 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:12:54 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:12:54 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:12:54 user nova-compute[74963]:       <entry name="serial">e4386623-a0b7-4145-8b84-2a7b64c3a98f</entry>
Nov 30 08:12:54 user nova-compute[74963]:       <entry name="uuid">e4386623-a0b7-4145-8b84-2a7b64c3a98f</entry>
Nov 30 08:12:54 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:12:54 user nova-compute[74963]:     </system>
Nov 30 08:12:54 user nova-compute[74963]:   </sysinfo>
Nov 30 08:12:54 user nova-compute[74963]:   <os>
Nov 30 08:12:54 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:12:54 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:12:54 user nova-compute[74963]:   </os>
Nov 30 08:12:54 user nova-compute[74963]:   <features>
Nov 30 08:12:54 user nova-compute[74963]:     <acpi/>
Nov 30 08:12:54 user nova-compute[74963]:     <apic/>
Nov 30 08:12:54 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:12:54 user nova-compute[74963]:   </features>
Nov 30 08:12:54 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:12:54 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:12:54 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:12:54 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:12:54 user nova-compute[74963]:   </clock>
Nov 30 08:12:54 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:12:54 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:12:54 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:12:54 user nova-compute[74963]:   </cpu>
Nov 30 08:12:54 user nova-compute[74963]:   <devices>
Nov 30 08:12:54 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:12:54 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:12:54 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue"/>
Nov 30 08:12:54 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:12:54 user nova-compute[74963]:     </disk>
Nov 30 08:12:54 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:12:54 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:12:54 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk"/>
Nov 30 08:12:54 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:12:54 user nova-compute[74963]:     </disk>
Nov 30 08:12:54 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:12:54 user nova-compute[74963]:       <mac address="fa:16:3e:e2:33:a3"/>
Nov 30 08:12:54 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:12:54 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:12:54 user nova-compute[74963]:       <target dev="tap8dfabd89-d7"/>
Nov 30 08:12:54 user nova-compute[74963]:     </interface>
Nov 30 08:12:54 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:12:54 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/console.log" append="off"/>
Nov 30 08:12:54 user nova-compute[74963]:     </serial>
Nov 30 08:12:54 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:12:54 user nova-compute[74963]:     <video>
Nov 30 08:12:54 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:12:54 user nova-compute[74963]:     </video>
Nov 30 08:12:54 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:12:54 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:12:54 user nova-compute[74963]:     </rng>
Nov 30 08:12:54 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:12:54 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:12:54 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:12:54 user nova-compute[74963]:     </memballoon>
Nov 30 08:12:54 user nova-compute[74963]:   </devices>
Nov 30 08:12:54 user nova-compute[74963]: </domain>
Nov 30 08:12:54 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:12:54 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Instance destroyed successfully.
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:12:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No VIF found with MAC fa:16:3e:e2:33:a3, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:12:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb855029-8201-4c59-a4d2-3fac4a14fec9 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-9a85a482-04e6-4ab2-8018-968992fc9060 req-1fc8fc4d-3aa0-4d5f-ad8f-14203a1385ad service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9a85a482-04e6-4ab2-8018-968992fc9060 req-1fc8fc4d-3aa0-4d5f-ad8f-14203a1385ad service nova] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9a85a482-04e6-4ab2-8018-968992fc9060 req-1fc8fc4d-3aa0-4d5f-ad8f-14203a1385ad service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9a85a482-04e6-4ab2-8018-968992fc9060 req-1fc8fc4d-3aa0-4d5f-ad8f-14203a1385ad service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-9a85a482-04e6-4ab2-8018-968992fc9060 req-1fc8fc4d-3aa0-4d5f-ad8f-14203a1385ad service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] No waiting events found dispatching network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:56 user nova-compute[74963]: WARNING nova.compute.manager [req-9a85a482-04e6-4ab2-8018-968992fc9060 req-1fc8fc4d-3aa0-4d5f-ad8f-14203a1385ad service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received unexpected event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 for instance with vm_state active and task_state rescuing.
Nov 30 08:12:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] No waiting events found dispatching network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:58 user nova-compute[74963]: WARNING nova.compute.manager [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received unexpected event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 for instance with vm_state active and task_state rescuing.
Nov 30 08:12:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] No waiting events found dispatching network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:12:58 user nova-compute[74963]: WARNING nova.compute.manager [req-f65bfe80-b0f8-472d-886e-e5dcfb2510b8 req-f2535534-6781-4ebc-a639-891d93477ed0 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received unexpected event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 for instance with vm_state active and task_state rescuing.
Nov 30 08:12:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:58 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d5c5e8f8-4eae-474d-b105-909797318782 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:12:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:13:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:03 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:13:03 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7901MB free_disk=25.37115478515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 25afcf51-de30-4a53-bb6b-3e7037f5e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 67d99f85-78de-4702-aa55-758173230187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 3551893b-4a59-4e6a-a961-8ea6d671632e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance bb855029-8201-4c59-a4d2-3fac4a14fec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:13:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-05de1019-03a9-4ff5-ae85-b311fe5e768b req-eba6e85b-2fe4-4625-b529-1f8989be5675 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received event network-changed-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-05de1019-03a9-4ff5-ae85-b311fe5e768b req-eba6e85b-2fe4-4625-b529-1f8989be5675 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Refreshing instance network info cache due to event network-changed-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-05de1019-03a9-4ff5-ae85-b311fe5e768b req-eba6e85b-2fe4-4625-b529-1f8989be5675 service nova] Acquiring lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-05de1019-03a9-4ff5-ae85-b311fe5e768b req-eba6e85b-2fe4-4625-b529-1f8989be5675 service nova] Acquired lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-05de1019-03a9-4ff5-ae85-b311fe5e768b req-eba6e85b-2fe4-4625-b529-1f8989be5675 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Refreshing network info cache for port bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-05de1019-03a9-4ff5-ae85-b311fe5e768b req-eba6e85b-2fe4-4625-b529-1f8989be5675 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updated VIF entry in instance network info cache for port bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-05de1019-03a9-4ff5-ae85-b311fe5e768b req-eba6e85b-2fe4-4625-b529-1f8989be5675 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updating instance_info_cache with network_info: [{"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-05de1019-03a9-4ff5-ae85-b311fe5e768b req-eba6e85b-2fe4-4625-b529-1f8989be5675 service nova] Releasing lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:13:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updating instance_info_cache with network_info: [{"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:13:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:13:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:13 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67d99f85-78de-4702-aa55-758173230187 is timed out.
Nov 30 08:13:13 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully detached device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the live domain config.
Nov 30 08:13:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHgLyZWI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:13:13 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:13:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca9123e-3623-4e47-b882-82d8d2c9463c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:13:13 user nova-compute[74963]: No targets found.
Nov 30 08:13:13 user nova-compute[74963]: iSNS:
Nov 30 08:13:13 user nova-compute[74963]: No targets found.
Nov 30 08:13:13 user nova-compute[74963]: STATIC:
Nov 30 08:13:13 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f
Nov 30 08:13:13 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:13:13 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:13:13 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:13:13 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:13:13 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:13:13 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1
Nov 30 08:13:13 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:13:13 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:13:13 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:13:13 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:13:13 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:13:13 user nova-compute[74963]: FIRMWARE:
Nov 30 08:13:13 user nova-compute[74963]: No targets found.
Nov 30 08:13:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:13:13 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:13:13 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[150f77db-447b-4e43-9c87-bd44f92cacbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a953bf-9ba4-4a30-8009-cfc39effe300]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:13:13 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:13:13 user nova-compute[74963]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)
Nov 30 08:13:13 user nova-compute[74963]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f (non-flash)
Nov 30 08:13:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:13:14 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:13:14 user nova-compute[74963]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 (non-flash)
Nov 30 08:13:14 user nova-compute[74963]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f (non-flash)
Nov 30 08:13:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624d0e1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1'): ({'sdc'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Removing single pathed devices sdc {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4504a190-12d7-479c-86fa-52c4e3692d5e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b2eb7e-a24d-4847-8603-172371777de4]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Flushing IO for device /dev/sdc {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71c1311-9e80-447d-a171-8829446c67ae]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d286362-a264-4468-9a1e-dfa23fec4c74]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d093ab79-a179-46ab-9b7e-4b2f67659c7c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4421288-a844-4c3e-9a2b-57387c65d2c9]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1, portal: 172.16.0.220,3260]
Nov 30 08:13:14 user nova-compute[74963]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1, portal: 172.16.0.220,3260] successful.
Nov 30 08:13:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3615a2a-3b12-408d-8a5a-bb5be875b5c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3742d6aa-1415-4f30-bbc4-10fdd34b8983]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== disconnect_volume: return (311ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:13:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:15 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb855029-8201-4c59-a4d2-3fac4a14fec9 is timed out.
Nov 30 08:13:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Successfully detached device vdb from instance bb855029-8201-4c59-a4d2-3fac4a14fec9 from the live domain config.
Nov 30 08:13:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irjvGOJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:13:15 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ed7a51-105d-4e52-9ffb-13e993e388f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:13:15 user nova-compute[74963]: No targets found.
Nov 30 08:13:15 user nova-compute[74963]: iSNS:
Nov 30 08:13:15 user nova-compute[74963]: No targets found.
Nov 30 08:13:15 user nova-compute[74963]: STATIC:
Nov 30 08:13:15 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f
Nov 30 08:13:15 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:13:15 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:13:15 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:13:15 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:13:15 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:13:15 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:13:15 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:13:15 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:13:15 user nova-compute[74963]: FIRMWARE:
Nov 30 08:13:15 user nova-compute[74963]: No targets found.
Nov 30 08:13:15 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:13:15 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:13:15 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20d160b-9b55-4f8c-930e-af638d7853c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3979b5-cb22-4e2a-836f-4bb112173558]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:13:15 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:13:15 user nova-compute[74963]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f (non-flash)
Nov 30 08:13:15 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:13:15 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:13:15 user nova-compute[74963]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f (non-flash)
Nov 30 08:13:15 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624438be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f'): ({'sde'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Removing single pathed devices sde {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[35297923-5fb9-4e16-a708-e55238e07c4a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e957273b-1bf0-4262-abde-1208701ccd26]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Flushing IO for device /dev/sde {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc167cc-72fd-4bad-98e9-ae23bcbf934b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f147d53b-08ac-45d4-8c6f-6d6da830f46f]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8bd10b-5547-4704-b403-d1f5842bc296]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b67426-ae7a-47f5-9610-9ae6ca901dc3]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f, portal: 172.16.0.220,3260]
Nov 30 08:13:15 user nova-compute[74963]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f, portal: 172.16.0.220,3260] successful.
Nov 30 08:13:15 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed3302a-dc62-4909-9fbb-ec6250b0249f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9a2f55-3355-4f7b-b396-91c7c9903de5]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] <== disconnect_volume: return (308ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:13:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:13:16 user nova-compute[74963]: DEBUG nova.objects.instance [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lazy-loading 'flavor' on Instance uuid bb855029-8201-4c59-a4d2-3fac4a14fec9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:13:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1207df48-804f-47bc-bf48-1460f19c9fc1 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.784s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:18 user nova-compute[74963]: DEBUG nova.objects.instance [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:13:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7a35249f-49a6-45e7-98ae-142978389347 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.869s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:21 user nova-compute[74963]: DEBUG nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:13:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:13:21 user nova-compute[74963]: INFO nova.compute.claims [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Claim successful on node user
Nov 30 08:13:21 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:13:21 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:13:22 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:13:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG nova.policy [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0406077bdf143258a2d84290bb449da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa068a8025245e0aa581bfad0b5c324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:13:22 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Creating image(s)
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "/opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "/opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk 1073741824" returned: 0 in 0.070s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.201s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:13:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Successfully created port: af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Cannot resize image /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Ensure instance console log exists: /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Successfully updated port: af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquired lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-2a512456-3554-4498-9c0a-e4e240739945 req-a8f6cb81-dc47-4131-b7d5-ccd11376bb2a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received event network-changed-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-2a512456-3554-4498-9c0a-e4e240739945 req-a8f6cb81-dc47-4131-b7d5-ccd11376bb2a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Refreshing instance network info cache due to event network-changed-af87f011-b963-479f-8d02-ed38ce604c3d. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2a512456-3554-4498-9c0a-e4e240739945 req-a8f6cb81-dc47-4131-b7d5-ccd11376bb2a service nova] Acquiring lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:13:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.network.neutron [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Updating instance_info_cache with network_info: [{"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Releasing lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Instance network_info: |[{"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2a512456-3554-4498-9c0a-e4e240739945 req-a8f6cb81-dc47-4131-b7d5-ccd11376bb2a service nova] Acquired lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-2a512456-3554-4498-9c0a-e4e240739945 req-a8f6cb81-dc47-4131-b7d5-ccd11376bb2a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Refreshing network info cache for port af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Start _get_guest_xml network_info=[{"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:13:24 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:13:24 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-44942850',display_name='tempest-TestStampPattern-server-44942850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-44942850',id=18,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXIfFHcf5hZJI1eOXWVSrzGJVOsClL3sRsQglOYWvzxqFcx/NwLGZqv1l34N2xD8aFbH1Lm1nfJS/HKaYuBZq5gxNl5qlH94PvOr+veB7phGIVgZOlhO4hSirM+QIZFUw==',key_name='tempest-TestStampPattern-1283092476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fa068a8025245e0aa581bfad0b5c324',ramdisk_id='',reservation_id='r-r6338epo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-14898091',owner_user_name='tempest-TestStampPattern-14898091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:13:22Z,user_data=None,user_id='a0406077bdf143258a2d84290bb449da',uuid=fd313577-5b50-48f3-b224-68542b958d21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converting VIF {"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:db:51,bridge_name='br-int',has_traffic_filtering=True,id=af87f011-b963-479f-8d02-ed38ce604c3d,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf87f011-b9') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.objects.instance [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'pci_devices' on Instance uuid fd313577-5b50-48f3-b224-68542b958d21 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:13:24 user nova-compute[74963]:   <uuid>fd313577-5b50-48f3-b224-68542b958d21</uuid>
Nov 30 08:13:24 user nova-compute[74963]:   <name>instance-00000012</name>
Nov 30 08:13:24 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:13:24 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:13:24 user nova-compute[74963]:   <metadata>
Nov 30 08:13:24 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:13:24 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:13:24 user nova-compute[74963]:       <nova:name>tempest-TestStampPattern-server-44942850</nova:name>
Nov 30 08:13:24 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:13:24</nova:creationTime>
Nov 30 08:13:24 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:13:24 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:13:24 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:13:24 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:13:24 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:13:24 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:13:24 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:13:24 user nova-compute[74963]:       <nova:owner>
Nov 30 08:13:24 user nova-compute[74963]:         <nova:user uuid="a0406077bdf143258a2d84290bb449da">tempest-TestStampPattern-14898091-project-member</nova:user>
Nov 30 08:13:24 user nova-compute[74963]:         <nova:project uuid="9fa068a8025245e0aa581bfad0b5c324">tempest-TestStampPattern-14898091</nova:project>
Nov 30 08:13:24 user nova-compute[74963]:       </nova:owner>
Nov 30 08:13:24 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:13:24 user nova-compute[74963]:       <nova:ports>
Nov 30 08:13:24 user nova-compute[74963]:         <nova:port uuid="af87f011-b963-479f-8d02-ed38ce604c3d">
Nov 30 08:13:24 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 08:13:24 user nova-compute[74963]:         </nova:port>
Nov 30 08:13:24 user nova-compute[74963]:       </nova:ports>
Nov 30 08:13:24 user nova-compute[74963]:     </nova:instance>
Nov 30 08:13:24 user nova-compute[74963]:   </metadata>
Nov 30 08:13:24 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:13:24 user nova-compute[74963]:     <system>
Nov 30 08:13:24 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:13:24 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:13:24 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:13:24 user nova-compute[74963]:       <entry name="serial">fd313577-5b50-48f3-b224-68542b958d21</entry>
Nov 30 08:13:24 user nova-compute[74963]:       <entry name="uuid">fd313577-5b50-48f3-b224-68542b958d21</entry>
Nov 30 08:13:24 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:13:24 user nova-compute[74963]:     </system>
Nov 30 08:13:24 user nova-compute[74963]:   </sysinfo>
Nov 30 08:13:24 user nova-compute[74963]:   <os>
Nov 30 08:13:24 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:13:24 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:13:24 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:13:24 user nova-compute[74963]:   </os>
Nov 30 08:13:24 user nova-compute[74963]:   <features>
Nov 30 08:13:24 user nova-compute[74963]:     <acpi/>
Nov 30 08:13:24 user nova-compute[74963]:     <apic/>
Nov 30 08:13:24 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:13:24 user nova-compute[74963]:   </features>
Nov 30 08:13:24 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:13:24 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:13:24 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:13:24 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:13:24 user nova-compute[74963]:   </clock>
Nov 30 08:13:24 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:13:24 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:13:24 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:13:24 user nova-compute[74963]:   </cpu>
Nov 30 08:13:24 user nova-compute[74963]:   <devices>
Nov 30 08:13:24 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:13:24 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:13:24 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk"/>
Nov 30 08:13:24 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:13:24 user nova-compute[74963]:     </disk>
Nov 30 08:13:24 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:13:24 user nova-compute[74963]:       <mac address="fa:16:3e:29:db:51"/>
Nov 30 08:13:24 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:13:24 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:13:24 user nova-compute[74963]:       <target dev="tapaf87f011-b9"/>
Nov 30 08:13:24 user nova-compute[74963]:     </interface>
Nov 30 08:13:24 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:13:24 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/console.log" append="off"/>
Nov 30 08:13:24 user nova-compute[74963]:     </serial>
Nov 30 08:13:24 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:13:24 user nova-compute[74963]:     <video>
Nov 30 08:13:24 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:13:24 user nova-compute[74963]:     </video>
Nov 30 08:13:24 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:13:24 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:13:24 user nova-compute[74963]:     </rng>
Nov 30 08:13:24 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:13:24 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:13:24 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:13:24 user nova-compute[74963]:     </memballoon>
Nov 30 08:13:24 user nova-compute[74963]:   </devices>
Nov 30 08:13:24 user nova-compute[74963]: </domain>
Nov 30 08:13:24 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-44942850',display_name='tempest-TestStampPattern-server-44942850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-44942850',id=18,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXIfFHcf5hZJI1eOXWVSrzGJVOsClL3sRsQglOYWvzxqFcx/NwLGZqv1l34N2xD8aFbH1Lm1nfJS/HKaYuBZq5gxNl5qlH94PvOr+veB7phGIVgZOlhO4hSirM+QIZFUw==',key_name='tempest-TestStampPattern-1283092476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fa068a8025245e0aa581bfad0b5c324',ramdisk_id='',reservation_id='r-r6338epo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-14898091',owner_user_name='tempest-TestStampPattern-14898091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:13:22Z,user_data=None,user_id='a0406077bdf143258a2d84290bb449da',uuid=fd313577-5b50-48f3-b224-68542b958d21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converting VIF {"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:db:51,bridge_name='br-int',has_traffic_filtering=True,id=af87f011-b963-479f-8d02-ed38ce604c3d,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf87f011-b9') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG os_vif [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:db:51,bridge_name='br-int',has_traffic_filtering=True,id=af87f011-b963-479f-8d02-ed38ce604c3d,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf87f011-b9') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de845ec5-6ab2-562e-aa30-d1d19919692a', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf87f011-b9, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf87f011-b9, col_values=(('qos', UUID('d84e467a-67b1-429e-b06a-aa2440b6d3f7')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf87f011-b9, col_values=(('external_ids', {'iface-id': 'af87f011-b963-479f-8d02-ed38ce604c3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:db:51', 'vm-uuid': 'fd313577-5b50-48f3-b224-68542b958d21'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:24 user nova-compute[74963]: INFO os_vif [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:db:51,bridge_name='br-int',has_traffic_filtering=True,id=af87f011-b963-479f-8d02-ed38ce604c3d,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf87f011-b9')
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No VIF found with MAC fa:16:3e:29:db:51, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-2a512456-3554-4498-9c0a-e4e240739945 req-a8f6cb81-dc47-4131-b7d5-ccd11376bb2a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Updated VIF entry in instance network info cache for port af87f011-b963-479f-8d02-ed38ce604c3d. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-2a512456-3554-4498-9c0a-e4e240739945 req-a8f6cb81-dc47-4131-b7d5-ccd11376bb2a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Updating instance_info_cache with network_info: [{"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:13:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2a512456-3554-4498-9c0a-e4e240739945 req-a8f6cb81-dc47-4131-b7d5-ccd11376bb2a service nova] Releasing lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:13:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-19cbba05-429e-45fc-bd9d-ce1edbf9d8f9 req-73fbc9e4-45a3-4982-ba76-ab328e50325c service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received event network-vif-plugged-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:13:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-19cbba05-429e-45fc-bd9d-ce1edbf9d8f9 req-73fbc9e4-45a3-4982-ba76-ab328e50325c service nova] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-19cbba05-429e-45fc-bd9d-ce1edbf9d8f9 req-73fbc9e4-45a3-4982-ba76-ab328e50325c service nova] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-19cbba05-429e-45fc-bd9d-ce1edbf9d8f9 req-73fbc9e4-45a3-4982-ba76-ab328e50325c service nova] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-19cbba05-429e-45fc-bd9d-ce1edbf9d8f9 req-73fbc9e4-45a3-4982-ba76-ab328e50325c service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] No waiting events found dispatching network-vif-plugged-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:13:25 user nova-compute[74963]: WARNING nova.compute.manager [req-19cbba05-429e-45fc-bd9d-ce1edbf9d8f9 req-73fbc9e4-45a3-4982-ba76-ab328e50325c service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received unexpected event network-vif-plugged-af87f011-b963-479f-8d02-ed38ce604c3d for instance with vm_state building and task_state spawning.
Nov 30 08:13:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:27 user nova-compute[74963]: DEBUG nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:13:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:13:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: fd313577-5b50-48f3-b224-68542b958d21] Instance spawned successfully.
Nov 30 08:13:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:13:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-05327254-c9e2-4330-8a5f-3b39dbced0ae req-81c38c75-2535-41cd-8f20-b5410761d69b service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received event network-vif-plugged-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:13:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-05327254-c9e2-4330-8a5f-3b39dbced0ae req-81c38c75-2535-41cd-8f20-b5410761d69b service nova] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-05327254-c9e2-4330-8a5f-3b39dbced0ae req-81c38c75-2535-41cd-8f20-b5410761d69b service nova] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-05327254-c9e2-4330-8a5f-3b39dbced0ae req-81c38c75-2535-41cd-8f20-b5410761d69b service nova] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-05327254-c9e2-4330-8a5f-3b39dbced0ae req-81c38c75-2535-41cd-8f20-b5410761d69b service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] No waiting events found dispatching network-vif-plugged-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:13:28 user nova-compute[74963]: WARNING nova.compute.manager [req-05327254-c9e2-4330-8a5f-3b39dbced0ae req-81c38c75-2535-41cd-8f20-b5410761d69b service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received unexpected event network-vif-plugged-af87f011-b963-479f-8d02-ed38ce604c3d for instance with vm_state building and task_state spawning.
Nov 30 08:13:28 user nova-compute[74963]: INFO nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 30 08:13:28 user nova-compute[74963]: DEBUG nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:13:28 user nova-compute[74963]: INFO nova.compute.manager [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Took 6.55 seconds to build instance.
Nov 30 08:13:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94d02646-85a5-48f5-b304-52a39e0faad3 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.649s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "9e48354e-9397-4305-914e-15a27651ea04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "9e48354e-9397-4305-914e-15a27651ea04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG nova.objects.instance [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:13:46 user nova-compute[74963]: INFO nova.compute.claims [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Claim successful on node user
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:46 user nova-compute[74963]: INFO nova.compute.manager [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attaching volume e5a7fa16-ecae-45dc-ad0f-967abed2fcab to /dev/vdb
Nov 30 08:13:46 user nova-compute[74963]: DEBUG os_brick.utils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[11915ee3-dd1c-446d-9902-b0fa90441c34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a0bb9e-d26b-46a4-8ba9-1b1921932148]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8fe6a1-7416-4803-b136-09a054c7d060]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f390912-d44a-4f44-ae1d-a92c3ddedbbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:13:46 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[41248f6f-2246-4ffa-8bfd-d6282fc6aeb8]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG os_brick.utils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating existing volume attachment record: 61acbba3-f964-4fd3-b818-46ab4f1b4bf3 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:46 user nova-compute[74963]: DEBUG nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG nova.network.neutron [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:13:47 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:13:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG nova.policy [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85ae318785fd41ec87f9598fd18c593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a587ec45f21498ea140a9989398052e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:13:47 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Creating image(s)
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "/opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "/opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.168s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk 1073741824" returned: 0 in 0.064s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:13:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Cannot resize image /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Ensure instance console log exists: /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG nova.network.neutron [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Successfully created port: d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG nova.network.neutron [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Successfully updated port: d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "refresh_cache-9e48354e-9397-4305-914e-15a27651ea04" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquired lock "refresh_cache-9e48354e-9397-4305-914e-15a27651ea04" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG nova.network.neutron [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-9debbea3-e828-4e0e-843c-e6a5923e255c req-814a974b-2a3d-4015-87ce-3b700ed0cc01 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received event network-changed-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-9debbea3-e828-4e0e-843c-e6a5923e255c req-814a974b-2a3d-4015-87ce-3b700ed0cc01 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Refreshing instance network info cache due to event network-changed-d65ca907-3ae7-470a-8b69-62622eb230f3. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9debbea3-e828-4e0e-843c-e6a5923e255c req-814a974b-2a3d-4015-87ce-3b700ed0cc01 service nova] Acquiring lock "refresh_cache-9e48354e-9397-4305-914e-15a27651ea04" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:13:48 user nova-compute[74963]: DEBUG nova.network.neutron [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.network.neutron [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Updating instance_info_cache with network_info: [{"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Releasing lock "refresh_cache-9e48354e-9397-4305-914e-15a27651ea04" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Instance network_info: |[{"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9debbea3-e828-4e0e-843c-e6a5923e255c req-814a974b-2a3d-4015-87ce-3b700ed0cc01 service nova] Acquired lock "refresh_cache-9e48354e-9397-4305-914e-15a27651ea04" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.network.neutron [req-9debbea3-e828-4e0e-843c-e6a5923e255c req-814a974b-2a3d-4015-87ce-3b700ed0cc01 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Refreshing network info cache for port d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Start _get_guest_xml network_info=[{"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:13:49 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:13:49 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1881772643',display_name='tempest-VolumesAdminNegativeTest-server-1881772643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1881772643',id=19,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a587ec45f21498ea140a9989398052e',ramdisk_id='',reservation_id='r-pldcoyh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1226639972',owner_user_name='tempest-VolumesAdminNegativeTest-1226639972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:13:47Z,user_data=None,user_id='85ae318785fd41ec87f9598fd18c593a',uuid=9e48354e-9397-4305-914e-15a27651ea04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converting VIF {"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bd:be,bridge_name='br-int',has_traffic_filtering=True,id=d65ca907-3ae7-470a-8b69-62622eb230f3,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65ca907-3a') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.objects.instance [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e48354e-9397-4305-914e-15a27651ea04 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:13:49 user nova-compute[74963]:   <uuid>9e48354e-9397-4305-914e-15a27651ea04</uuid>
Nov 30 08:13:49 user nova-compute[74963]:   <name>instance-00000013</name>
Nov 30 08:13:49 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:13:49 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:13:49 user nova-compute[74963]:   <metadata>
Nov 30 08:13:49 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:13:49 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:13:49 user nova-compute[74963]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1881772643</nova:name>
Nov 30 08:13:49 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:13:49</nova:creationTime>
Nov 30 08:13:49 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:13:49 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:13:49 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:13:49 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:13:49 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:13:49 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:13:49 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:13:49 user nova-compute[74963]:       <nova:owner>
Nov 30 08:13:49 user nova-compute[74963]:         <nova:user uuid="85ae318785fd41ec87f9598fd18c593a">tempest-VolumesAdminNegativeTest-1226639972-project-member</nova:user>
Nov 30 08:13:49 user nova-compute[74963]:         <nova:project uuid="6a587ec45f21498ea140a9989398052e">tempest-VolumesAdminNegativeTest-1226639972</nova:project>
Nov 30 08:13:49 user nova-compute[74963]:       </nova:owner>
Nov 30 08:13:49 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:13:49 user nova-compute[74963]:       <nova:ports>
Nov 30 08:13:49 user nova-compute[74963]:         <nova:port uuid="d65ca907-3ae7-470a-8b69-62622eb230f3">
Nov 30 08:13:49 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 08:13:49 user nova-compute[74963]:         </nova:port>
Nov 30 08:13:49 user nova-compute[74963]:       </nova:ports>
Nov 30 08:13:49 user nova-compute[74963]:     </nova:instance>
Nov 30 08:13:49 user nova-compute[74963]:   </metadata>
Nov 30 08:13:49 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:13:49 user nova-compute[74963]:     <system>
Nov 30 08:13:49 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:13:49 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:13:49 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:13:49 user nova-compute[74963]:       <entry name="serial">9e48354e-9397-4305-914e-15a27651ea04</entry>
Nov 30 08:13:49 user nova-compute[74963]:       <entry name="uuid">9e48354e-9397-4305-914e-15a27651ea04</entry>
Nov 30 08:13:49 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:13:49 user nova-compute[74963]:     </system>
Nov 30 08:13:49 user nova-compute[74963]:   </sysinfo>
Nov 30 08:13:49 user nova-compute[74963]:   <os>
Nov 30 08:13:49 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:13:49 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:13:49 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:13:49 user nova-compute[74963]:   </os>
Nov 30 08:13:49 user nova-compute[74963]:   <features>
Nov 30 08:13:49 user nova-compute[74963]:     <acpi/>
Nov 30 08:13:49 user nova-compute[74963]:     <apic/>
Nov 30 08:13:49 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:13:49 user nova-compute[74963]:   </features>
Nov 30 08:13:49 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:13:49 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:13:49 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:13:49 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:13:49 user nova-compute[74963]:   </clock>
Nov 30 08:13:49 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:13:49 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:13:49 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:13:49 user nova-compute[74963]:   </cpu>
Nov 30 08:13:49 user nova-compute[74963]:   <devices>
Nov 30 08:13:49 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:13:49 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:13:49 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk"/>
Nov 30 08:13:49 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:13:49 user nova-compute[74963]:     </disk>
Nov 30 08:13:49 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:13:49 user nova-compute[74963]:       <mac address="fa:16:3e:1d:bd:be"/>
Nov 30 08:13:49 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:13:49 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:13:49 user nova-compute[74963]:       <target dev="tapd65ca907-3a"/>
Nov 30 08:13:49 user nova-compute[74963]:     </interface>
Nov 30 08:13:49 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:13:49 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/console.log" append="off"/>
Nov 30 08:13:49 user nova-compute[74963]:     </serial>
Nov 30 08:13:49 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:13:49 user nova-compute[74963]:     <video>
Nov 30 08:13:49 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:13:49 user nova-compute[74963]:     </video>
Nov 30 08:13:49 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:13:49 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:13:49 user nova-compute[74963]:     </rng>
Nov 30 08:13:49 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:13:49 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:13:49 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:13:49 user nova-compute[74963]:     </memballoon>
Nov 30 08:13:49 user nova-compute[74963]:   </devices>
Nov 30 08:13:49 user nova-compute[74963]: </domain>
Nov 30 08:13:49 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1881772643',display_name='tempest-VolumesAdminNegativeTest-server-1881772643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1881772643',id=19,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a587ec45f21498ea140a9989398052e',ramdisk_id='',reservation_id='r-pldcoyh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1226639972',owner_user_name='tempest-VolumesAdminNegativeTest-1226639972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:13:47Z,user_data=None,user_id='85ae318785fd41ec87f9598fd18c593a',uuid=9e48354e-9397-4305-914e-15a27651ea04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converting VIF {"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bd:be,bridge_name='br-int',has_traffic_filtering=True,id=d65ca907-3ae7-470a-8b69-62622eb230f3,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65ca907-3a') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG os_vif [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bd:be,bridge_name='br-int',has_traffic_filtering=True,id=d65ca907-3ae7-470a-8b69-62622eb230f3,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65ca907-3a') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7bc085a-5e17-5ece-910a-b014f1b7df5c', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd65ca907-3a, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd65ca907-3a, col_values=(('qos', UUID('071ba922-feaa-4649-baba-f04f20d8ecdd')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd65ca907-3a, col_values=(('external_ids', {'iface-id': 'd65ca907-3ae7-470a-8b69-62622eb230f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:bd:be', 'vm-uuid': '9e48354e-9397-4305-914e-15a27651ea04'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:49 user nova-compute[74963]: INFO os_vif [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bd:be,bridge_name='br-int',has_traffic_filtering=True,id=d65ca907-3ae7-470a-8b69-62622eb230f3,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65ca907-3a')
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] No VIF found with MAC fa:16:3e:1d:bd:be, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.network.neutron [req-9debbea3-e828-4e0e-843c-e6a5923e255c req-814a974b-2a3d-4015-87ce-3b700ed0cc01 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Updated VIF entry in instance network info cache for port d65ca907-3ae7-470a-8b69-62622eb230f3. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG nova.network.neutron [req-9debbea3-e828-4e0e-843c-e6a5923e255c req-814a974b-2a3d-4015-87ce-3b700ed0cc01 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Updating instance_info_cache with network_info: [{"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:13:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9debbea3-e828-4e0e-843c-e6a5923e255c req-814a974b-2a3d-4015-87ce-3b700ed0cc01 service nova] Releasing lock "refresh_cache-9e48354e-9397-4305-914e-15a27651ea04" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-a0b24e90-2fc2-4764-a312-913ec8febf0f req-a4a7f3e6-ff75-494f-9d0b-4df2ae5786d1 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received event network-vif-plugged-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0b24e90-2fc2-4764-a312-913ec8febf0f req-a4a7f3e6-ff75-494f-9d0b-4df2ae5786d1 service nova] Acquiring lock "9e48354e-9397-4305-914e-15a27651ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0b24e90-2fc2-4764-a312-913ec8febf0f req-a4a7f3e6-ff75-494f-9d0b-4df2ae5786d1 service nova] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0b24e90-2fc2-4764-a312-913ec8febf0f req-a4a7f3e6-ff75-494f-9d0b-4df2ae5786d1 service nova] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-a0b24e90-2fc2-4764-a312-913ec8febf0f req-a4a7f3e6-ff75-494f-9d0b-4df2ae5786d1 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] No waiting events found dispatching network-vif-plugged-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:13:50 user nova-compute[74963]: WARNING nova.compute.manager [req-a0b24e90-2fc2-4764-a312-913ec8febf0f req-a4a7f3e6-ff75-494f-9d0b-4df2ae5786d1 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received unexpected event network-vif-plugged-d65ca907-3ae7-470a-8b69-62622eb230f3 for instance with vm_state building and task_state spawning.
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:13:52 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Instance spawned successfully.
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:13:52 user nova-compute[74963]: INFO nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:13:52 user nova-compute[74963]: INFO nova.compute.manager [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Took 6.48 seconds to build instance.
Nov 30 08:13:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-810dbdfa-1d81-4767-b719-46852f8bd496 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "9e48354e-9397-4305-914e-15a27651ea04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.873s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-881d6124-55cd-47bd-9bb6-baa182e2d329 req-3da05604-e3fe-49f9-b41f-1dc43ff571b6 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received event network-vif-plugged-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-881d6124-55cd-47bd-9bb6-baa182e2d329 req-3da05604-e3fe-49f9-b41f-1dc43ff571b6 service nova] Acquiring lock "9e48354e-9397-4305-914e-15a27651ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-881d6124-55cd-47bd-9bb6-baa182e2d329 req-3da05604-e3fe-49f9-b41f-1dc43ff571b6 service nova] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-881d6124-55cd-47bd-9bb6-baa182e2d329 req-3da05604-e3fe-49f9-b41f-1dc43ff571b6 service nova] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-881d6124-55cd-47bd-9bb6-baa182e2d329 req-3da05604-e3fe-49f9-b41f-1dc43ff571b6 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] No waiting events found dispatching network-vif-plugged-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:13:52 user nova-compute[74963]: WARNING nova.compute.manager [req-881d6124-55cd-47bd-9bb6-baa182e2d329 req-3da05604-e3fe-49f9-b41f-1dc43ff571b6 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received unexpected event network-vif-plugged-d65ca907-3ae7-470a-8b69-62622eb230f3 for instance with vm_state active and task_state None.
Nov 30 08:13:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MsDqaZEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:13:55 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:13:55 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:13:55 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef66e45-cd54-4a5a-9467-dd445ec5f43c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:13:55 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8a3b33-cb75-4109-8b41-c30d42f0da37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab] added
Nov 30 08:13:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b2290a-fb49-4761-a44f-9d9069b9648c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b222a3e3-60fb-43ee-8c61-f7a4655c414c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MsDqaZEe {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MsDqaZEe" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de580e4-aa4a-4218-97c8-94426960b4d5]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MsDqaZEe'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0aa0aa-52c4-4596-bdd0-3bd5f64c4905]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d0c1c1-279c-48dc-8f39-5eaa38b275d1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:13:55 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:13:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:13:55 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:13:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e99852-da1e-44ef-bfad-b8c477cce7c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab, portal: 172.16.0.220,3260]
Nov 30 08:13:55 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab, portal: 172.16.0.220,3260] successful.
Nov 30 08:13:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa254818-babb-4f69-b86c-03d4bc6e6c41]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[315721fb-485c-4bba-96ef-2396dc89f90c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:13:55 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:13:55 user nova-compute[74963]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab (non-flash)
Nov 30 08:13:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:13:55 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:13:55 user nova-compute[74963]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab (non-flash)
Nov 30 08:13:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf585cc0-5fc6-45f5-9126-08fa862abe5c]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:13:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MsDqaZEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:13:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:13:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26634626265383233', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:13:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634626265383233', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:13:56 user nova-compute[74963]: DEBUG nova.objects.instance [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:13:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:13:56 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:13:56 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:13:56 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:13:56 user nova-compute[74963]:   <serial>e5a7fa16-ecae-45dc-ad0f-967abed2fcab</serial>
Nov 30 08:13:56 user nova-compute[74963]: </disk>
Nov 30 08:13:56 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:13:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:13:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:13:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] No VIF found with MAC fa:16:3e:e2:e7:00, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:13:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c4c2e686-b608-4368-9cae-ee4ac321fbdf tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.829s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:13:59 user nova-compute[74963]: INFO nova.compute.manager [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Detaching volume e5a7fa16-ecae-45dc-ad0f-967abed2fcab
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:13:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:00 user nova-compute[74963]: INFO nova.virt.block_device [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Attempting to driver detach volume e5a7fa16-ecae-45dc-ad0f-967abed2fcab from mountpoint /dev/vdb
Nov 30 08:14:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Attempting to detach device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:14:00 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:14:00 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:14:00 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:14:00 user nova-compute[74963]:   <serial>e5a7fa16-ecae-45dc-ad0f-967abed2fcab</serial>
Nov 30 08:14:00 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:14:00 user nova-compute[74963]: </disk>
Nov 30 08:14:00 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:14:00 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully detached device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the persistent domain config.
Nov 30 08:14:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67d99f85-78de-4702-aa55-758173230187 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:14:00 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:14:00 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:14:00 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:14:00 user nova-compute[74963]:   <serial>e5a7fa16-ecae-45dc-ad0f-967abed2fcab</serial>
Nov 30 08:14:00 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:14:00 user nova-compute[74963]: </disk>
Nov 30 08:14:00 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:03 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:14:03 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7573MB free_disk=25.32925033569336GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 25afcf51-de30-4a53-bb6b-3e7037f5e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 67d99f85-78de-4702-aa55-758173230187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 3551893b-4a59-4e6a-a961-8ea6d671632e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance bb855029-8201-4c59-a4d2-3fac4a14fec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance fd313577-5b50-48f3-b224-68542b958d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9e48354e-9397-4305-914e-15a27651ea04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:14:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:14:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:04 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:14:04 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:14:04 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:14:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Updating instance_info_cache with network_info: [{"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-25afcf51-de30-4a53-bb6b-3e7037f5e386" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:14:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:14:07 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:14:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:20 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67d99f85-78de-4702-aa55-758173230187 is timed out.
Nov 30 08:14:20 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully detached device vdb from instance 67d99f85-78de-4702-aa55-758173230187 from the live domain config.
Nov 30 08:14:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MsDqaZEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:14:20 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5160742-c3a7-46ea-846f-b7dce4261680]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:14:20 user nova-compute[74963]: No targets found.
Nov 30 08:14:20 user nova-compute[74963]: iSNS:
Nov 30 08:14:20 user nova-compute[74963]: No targets found.
Nov 30 08:14:20 user nova-compute[74963]: STATIC:
Nov 30 08:14:20 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:14:20 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:14:20 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:14:20 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab
Nov 30 08:14:20 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:14:20 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:14:20 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:14:20 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:14:20 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:14:20 user nova-compute[74963]: FIRMWARE:
Nov 30 08:14:20 user nova-compute[74963]: No targets found.
Nov 30 08:14:20 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:14:20 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:14:20 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69d45a2-f791-44a9-a2f5-980e4ce7150f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cd6b25-dddd-48cf-aa14-bdbc63670408]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:14:20 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:14:20 user nova-compute[74963]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab (non-flash)
Nov 30 08:14:20 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:14:20 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:14:20 user nova-compute[74963]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab (non-flash)
Nov 30 08:14:20 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62442904c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab'): ({'sdc'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Removing single pathed devices sdc {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f17bd77-1fa9-43bf-bd0f-6af4d00c7cba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee3df8-6e46-42aa-bae8-3402f910480c]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Flushing IO for device /dev/sdc {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8a6ab8-4dc5-4cec-8fdf-969c177810cb]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdccf24f-c140-467a-9cb2-394182d2fde6]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7e569c-d331-4dab-941f-0b54cd229bc2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[14220d93-155d-4155-b4b7-b54dbf7a9393]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab, portal: 172.16.0.220,3260]
Nov 30 08:14:20 user nova-compute[74963]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab, portal: 172.16.0.220,3260] successful.
Nov 30 08:14:20 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a7fa16-ecae-45dc-ad0f-967abed2fcab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5938a967-e4f9-42ac-8125-21d9ac456bf9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] <== disconnect_volume: return (322ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:14:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:14:21 user nova-compute[74963]: DEBUG nova.objects.instance [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'flavor' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:14:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-98af33f3-56d3-43eb-9855-1b5fbcb95e68 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:14:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:14:38 user nova-compute[74963]: INFO nova.compute.claims [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Claim successful on node user
Nov 30 08:14:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:14:39 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:14:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG nova.policy [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b110fcb508342509690b45e1854eb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce233bd757b64de4bd6f6abb3230da01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:14:39 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Creating image(s)
Nov 30 08:14:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "/opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "/opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk 1073741824" returned: 0 in 0.050s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Successfully created port: 8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Cannot resize image /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Ensure instance console log exists: /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:40 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Successfully updated port: 8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "refresh_cache-dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquired lock "refresh_cache-dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-7b716e39-d058-4ece-9f54-3a7d8fbbc163 req-9747c106-2882-44c2-a498-e48a530dad1a service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received event network-changed-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-7b716e39-d058-4ece-9f54-3a7d8fbbc163 req-9747c106-2882-44c2-a498-e48a530dad1a service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Refreshing instance network info cache due to event network-changed-8f64dde7-746d-46bb-b42b-df2cbaa14592. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7b716e39-d058-4ece-9f54-3a7d8fbbc163 req-9747c106-2882-44c2-a498-e48a530dad1a service nova] Acquiring lock "refresh_cache-dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Updating instance_info_cache with network_info: [{"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Releasing lock "refresh_cache-dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Instance network_info: |[{"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7b716e39-d058-4ece-9f54-3a7d8fbbc163 req-9747c106-2882-44c2-a498-e48a530dad1a service nova] Acquired lock "refresh_cache-dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.neutron [req-7b716e39-d058-4ece-9f54-3a7d8fbbc163 req-9747c106-2882-44c2-a498-e48a530dad1a service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Refreshing network info cache for port 8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Start _get_guest_xml network_info=[{"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:14:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:14:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-327193947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-327193947',id=20,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-fbx0cwa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:14:40Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:ac,bridge_name='br-int',has_traffic_filtering=True,id=8f64dde7-746d-46bb-b42b-df2cbaa14592,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f64dde7-74') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'pci_devices' on Instance uuid dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:14:41 user nova-compute[74963]:   <uuid>dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105</uuid>
Nov 30 08:14:41 user nova-compute[74963]:   <name>instance-00000014</name>
Nov 30 08:14:41 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:14:41 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:14:41 user nova-compute[74963]:   <metadata>
Nov 30 08:14:41 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:14:41 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:14:41 user nova-compute[74963]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-327193947</nova:name>
Nov 30 08:14:41 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:14:41</nova:creationTime>
Nov 30 08:14:41 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:14:41 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:14:41 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:14:41 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:14:41 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:14:41 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:14:41 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:14:41 user nova-compute[74963]:       <nova:owner>
Nov 30 08:14:41 user nova-compute[74963]:         <nova:user uuid="4b110fcb508342509690b45e1854eb81">tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member</nova:user>
Nov 30 08:14:41 user nova-compute[74963]:         <nova:project uuid="ce233bd757b64de4bd6f6abb3230da01">tempest-ServerBootFromVolumeStableRescueTest-1834985655</nova:project>
Nov 30 08:14:41 user nova-compute[74963]:       </nova:owner>
Nov 30 08:14:41 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:14:41 user nova-compute[74963]:       <nova:ports>
Nov 30 08:14:41 user nova-compute[74963]:         <nova:port uuid="8f64dde7-746d-46bb-b42b-df2cbaa14592">
Nov 30 08:14:41 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 08:14:41 user nova-compute[74963]:         </nova:port>
Nov 30 08:14:41 user nova-compute[74963]:       </nova:ports>
Nov 30 08:14:41 user nova-compute[74963]:     </nova:instance>
Nov 30 08:14:41 user nova-compute[74963]:   </metadata>
Nov 30 08:14:41 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:14:41 user nova-compute[74963]:     <system>
Nov 30 08:14:41 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:14:41 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:14:41 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:14:41 user nova-compute[74963]:       <entry name="serial">dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105</entry>
Nov 30 08:14:41 user nova-compute[74963]:       <entry name="uuid">dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105</entry>
Nov 30 08:14:41 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:14:41 user nova-compute[74963]:     </system>
Nov 30 08:14:41 user nova-compute[74963]:   </sysinfo>
Nov 30 08:14:41 user nova-compute[74963]:   <os>
Nov 30 08:14:41 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:14:41 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:14:41 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:14:41 user nova-compute[74963]:   </os>
Nov 30 08:14:41 user nova-compute[74963]:   <features>
Nov 30 08:14:41 user nova-compute[74963]:     <acpi/>
Nov 30 08:14:41 user nova-compute[74963]:     <apic/>
Nov 30 08:14:41 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:14:41 user nova-compute[74963]:   </features>
Nov 30 08:14:41 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:14:41 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:14:41 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:14:41 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:14:41 user nova-compute[74963]:   </clock>
Nov 30 08:14:41 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:14:41 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:14:41 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:14:41 user nova-compute[74963]:   </cpu>
Nov 30 08:14:41 user nova-compute[74963]:   <devices>
Nov 30 08:14:41 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:14:41 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:14:41 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk"/>
Nov 30 08:14:41 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:14:41 user nova-compute[74963]:     </disk>
Nov 30 08:14:41 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:14:41 user nova-compute[74963]:       <mac address="fa:16:3e:2e:1a:ac"/>
Nov 30 08:14:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:14:41 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:14:41 user nova-compute[74963]:       <target dev="tap8f64dde7-74"/>
Nov 30 08:14:41 user nova-compute[74963]:     </interface>
Nov 30 08:14:41 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:14:41 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/console.log" append="off"/>
Nov 30 08:14:41 user nova-compute[74963]:     </serial>
Nov 30 08:14:41 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:14:41 user nova-compute[74963]:     <video>
Nov 30 08:14:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:14:41 user nova-compute[74963]:     </video>
Nov 30 08:14:41 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:14:41 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:14:41 user nova-compute[74963]:     </rng>
Nov 30 08:14:41 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:14:41 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:14:41 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:14:41 user nova-compute[74963]:     </memballoon>
Nov 30 08:14:41 user nova-compute[74963]:   </devices>
Nov 30 08:14:41 user nova-compute[74963]: </domain>
Nov 30 08:14:41 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-327193947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-327193947',id=20,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-fbx0cwa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:14:40Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:ac,bridge_name='br-int',has_traffic_filtering=True,id=8f64dde7-746d-46bb-b42b-df2cbaa14592,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f64dde7-74') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG os_vif [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:ac,bridge_name='br-int',has_traffic_filtering=True,id=8f64dde7-746d-46bb-b42b-df2cbaa14592,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f64dde7-74') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea86c8e8-e565-521e-a597-8d96a5f248d1', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f64dde7-74, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f64dde7-74, col_values=(('qos', UUID('53be2a74-dc6f-421b-b322-7c99afad8a5f')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f64dde7-74, col_values=(('external_ids', {'iface-id': '8f64dde7-746d-46bb-b42b-df2cbaa14592', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:1a:ac', 'vm-uuid': 'dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:41 user nova-compute[74963]: INFO os_vif [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:ac,bridge_name='br-int',has_traffic_filtering=True,id=8f64dde7-746d-46bb-b42b-df2cbaa14592,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f64dde7-74')
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No VIF found with MAC fa:16:3e:2e:1a:ac, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.neutron [req-7b716e39-d058-4ece-9f54-3a7d8fbbc163 req-9747c106-2882-44c2-a498-e48a530dad1a service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Updated VIF entry in instance network info cache for port 8f64dde7-746d-46bb-b42b-df2cbaa14592. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG nova.network.neutron [req-7b716e39-d058-4ece-9f54-3a7d8fbbc163 req-9747c106-2882-44c2-a498-e48a530dad1a service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Updating instance_info_cache with network_info: [{"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:14:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7b716e39-d058-4ece-9f54-3a7d8fbbc163 req-9747c106-2882-44c2-a498-e48a530dad1a service nova] Releasing lock "refresh_cache-dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:14:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-6e675283-4bac-4210-b567-6957513c5848 req-3d18a74e-6690-4f10-8d45-586821cff041 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received event network-vif-plugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:14:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6e675283-4bac-4210-b567-6957513c5848 req-3d18a74e-6690-4f10-8d45-586821cff041 service nova] Acquiring lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6e675283-4bac-4210-b567-6957513c5848 req-3d18a74e-6690-4f10-8d45-586821cff041 service nova] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6e675283-4bac-4210-b567-6957513c5848 req-3d18a74e-6690-4f10-8d45-586821cff041 service nova] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-6e675283-4bac-4210-b567-6957513c5848 req-3d18a74e-6690-4f10-8d45-586821cff041 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] No waiting events found dispatching network-vif-plugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:14:42 user nova-compute[74963]: WARNING nova.compute.manager [req-6e675283-4bac-4210-b567-6957513c5848 req-3d18a74e-6690-4f10-8d45-586821cff041 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received unexpected event network-vif-plugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 for instance with vm_state building and task_state spawning.
Nov 30 08:14:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:14:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Instance spawned successfully.
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:14:44 user nova-compute[74963]: INFO nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-47d02e6e-ae97-4d97-bb0d-375f525ed5ea req-1035f803-426f-4a0a-9953-a0f30b9049f4 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received event network-vif-plugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-47d02e6e-ae97-4d97-bb0d-375f525ed5ea req-1035f803-426f-4a0a-9953-a0f30b9049f4 service nova] Acquiring lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-47d02e6e-ae97-4d97-bb0d-375f525ed5ea req-1035f803-426f-4a0a-9953-a0f30b9049f4 service nova] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-47d02e6e-ae97-4d97-bb0d-375f525ed5ea req-1035f803-426f-4a0a-9953-a0f30b9049f4 service nova] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-47d02e6e-ae97-4d97-bb0d-375f525ed5ea req-1035f803-426f-4a0a-9953-a0f30b9049f4 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] No waiting events found dispatching network-vif-plugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:14:44 user nova-compute[74963]: WARNING nova.compute.manager [req-47d02e6e-ae97-4d97-bb0d-375f525ed5ea req-1035f803-426f-4a0a-9953-a0f30b9049f4 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received unexpected event network-vif-plugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 for instance with vm_state building and task_state spawning.
Nov 30 08:14:44 user nova-compute[74963]: INFO nova.compute.manager [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Took 6.27 seconds to build instance.
Nov 30 08:14:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c65c4870-0f5a-4e02-8f44-152cd3b9685a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.415s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "25afcf51-de30-4a53-bb6b-3e7037f5e386" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:57 user nova-compute[74963]: INFO nova.compute.manager [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Terminating instance
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-5e8f721e-c043-40b6-a5ba-cf53a347a449 req-1bc40afb-bdc5-42ec-acc8-b50ad1e549e6 service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received event network-vif-unplugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5e8f721e-c043-40b6-a5ba-cf53a347a449 req-1bc40afb-bdc5-42ec-acc8-b50ad1e549e6 service nova] Acquiring lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5e8f721e-c043-40b6-a5ba-cf53a347a449 req-1bc40afb-bdc5-42ec-acc8-b50ad1e549e6 service nova] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5e8f721e-c043-40b6-a5ba-cf53a347a449 req-1bc40afb-bdc5-42ec-acc8-b50ad1e549e6 service nova] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-5e8f721e-c043-40b6-a5ba-cf53a347a449 req-1bc40afb-bdc5-42ec-acc8-b50ad1e549e6 service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] No waiting events found dispatching network-vif-unplugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-5e8f721e-c043-40b6-a5ba-cf53a347a449 req-1bc40afb-bdc5-42ec-acc8-b50ad1e549e6 service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received event network-vif-unplugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Instance destroyed successfully.
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lazy-loading 'resources' on Instance uuid 25afcf51-de30-4a53-bb6b-3e7037f5e386 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2133869070',display_name='tempest-ServersNegativeTestJSON-server-2133869070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2133869070',id=4,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12e5b724c4d64e9f9900b7bad1c2a00f',ramdisk_id='',reservation_id='r-4myjh2kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1755407575',owner_user_name='tempest-ServersNegativeTestJSON-1755407575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:06:23Z,user_data=None,user_id='63de4ab983be439488dc30077810b5f0',uuid=25afcf51-de30-4a53-bb6b-3e7037f5e386,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converting VIF {"id": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "address": "fa:16:3e:f4:ea:4c", "network": {"id": "c2cd73ec-e3aa-4961-87f0-cab40716e7cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1644747960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e5b724c4d64e9f9900b7bad1c2a00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8b2c94-90", "ovs_interfaceid": "cd8b2c94-905e-4551-8ed2-8508fb3c658f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ea:4c,bridge_name='br-int',has_traffic_filtering=True,id=cd8b2c94-905e-4551-8ed2-8508fb3c658f,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8b2c94-90') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG os_vif [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ea:4c,bridge_name='br-int',has_traffic_filtering=True,id=cd8b2c94-905e-4551-8ed2-8508fb3c658f,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8b2c94-90') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd8b2c94-90, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d9df21b-db4a-410f-bb85-f21a3dcf1dba) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:57 user nova-compute[74963]: INFO os_vif [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ea:4c,bridge_name='br-int',has_traffic_filtering=True,id=cd8b2c94-905e-4551-8ed2-8508fb3c658f,network=Network(c2cd73ec-e3aa-4961-87f0-cab40716e7cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8b2c94-90')
Nov 30 08:14:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Deleting instance files /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386_del
Nov 30 08:14:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Deletion of /opt/stack/data/nova/instances/25afcf51-de30-4a53-bb6b-3e7037f5e386_del complete
Nov 30 08:14:57 user nova-compute[74963]: INFO nova.compute.manager [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 30 08:14:57 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:14:57 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:14:58 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:14:58 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Took 0.76 seconds to deallocate network for instance.
Nov 30 08:14:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:59 user nova-compute[74963]: INFO nova.compute.manager [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Terminating instance
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.135s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:14:59 user nova-compute[74963]: INFO nova.compute.claims [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Claim successful on node user
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Deleted allocations for instance 25afcf51-de30-4a53-bb6b-3e7037f5e386
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7fd4026a-3c29-44b0-a92a-464036eca869 tempest-ServersNegativeTestJSON-1755407575 tempest-ServersNegativeTestJSON-1755407575-project-member] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.203s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received event network-vif-plugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] Acquiring lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] Lock "25afcf51-de30-4a53-bb6b-3e7037f5e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] No waiting events found dispatching network-vif-plugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:14:59 user nova-compute[74963]: WARNING nova.compute.manager [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received unexpected event network-vif-plugged-cd8b2c94-905e-4551-8ed2-8508fb3c658f for instance with vm_state deleted and task_state None.
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] [instance: 25afcf51-de30-4a53-bb6b-3e7037f5e386] Received event network-vif-deleted-cd8b2c94-905e-4551-8ed2-8508fb3c658f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-unplugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-unplugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-c137d8fa-be83-4a9e-9d7f-8e30f3a26d19 req-12a0af05-ba2e-4acb-a729-e08e1075f8db service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-unplugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.network.neutron [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:14:59 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:14:59 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Instance destroyed successfully.
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lazy-loading 'resources' on Instance uuid 3551893b-4a59-4e6a-a961-8ea6d671632e {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1915210269',display_name='tempest-ServerActionsTestOtherB-server-1915210269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1915210269',id=1,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36ci9r8PQsZAIlncqo2lnhzQxOBqtCX/Nhuwzpg/1rHe+dDRDEWc3NXIhEOThN+3uJ2JkTtQ14Ec2v58DN2WowXRvVjxsTkVJ/eZYNznnLTsNFO26FNZYoSoo9gHV1uA==',key_name='tempest-keypair-1061087135',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:12:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb3709ed7b39464eb736837ee9167d04',ramdisk_id='',reservation_id='r-ij7puok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1961924021',owner_user_name='tempest-ServerActionsTestOtherB-1961924021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='709296ad4feb46a580f22f79a87233b4',uuid=3551893b-4a59-4e6a-a961-8ea6d671632e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converting VIF {"id": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "address": "fa:16:3e:35:ea:ab", "network": {"id": "a8a62de7-5a8c-4956-8be9-b78cbb15e32d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1853256577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3709ed7b39464eb736837ee9167d04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f867ffa-ae", "ovs_interfaceid": "9f867ffa-aeb8-4693-bce5-c4e507fad1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG os_vif [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f867ffa-ae, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae3092a7-df22-4864-ae79-1488ce72dc14) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:14:59 user nova-compute[74963]: INFO os_vif [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f867ffa-aeb8-4693-bce5-c4e507fad1a2,network=Network(a8a62de7-5a8c-4956-8be9-b78cbb15e32d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f867ffa-ae')
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzlsTFwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:14:59 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:14:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG nova.policy [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c803479aa87e4be79682975d47b7ccfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22db86fd7a54c5c9882623605de5608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead30492-edea-4c5a-a12b-e83289111922]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:14:59 user nova-compute[74963]: No targets found.
Nov 30 08:14:59 user nova-compute[74963]: iSNS:
Nov 30 08:14:59 user nova-compute[74963]: No targets found.
Nov 30 08:14:59 user nova-compute[74963]: STATIC:
Nov 30 08:14:59 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036
Nov 30 08:14:59 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:14:59 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:14:59 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:14:59 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:14:59 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:14:59 user nova-compute[74963]: FIRMWARE:
Nov 30 08:14:59 user nova-compute[74963]: No targets found.
Nov 30 08:14:59 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:14:59 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:14:59 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:14:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d3d0a5-79ae-4d46-8b45-49eb9e18d958]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[750e2c41-e48d-4b08-8f96-468f7f597469]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:15:00 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:15:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:15:00 user nova-compute[74963]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 (non-flash)
Nov 30 08:15:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6220754550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:15:00 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Creating image(s)
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[84448c11-25fd-4b16-a1c0-9ba919f800e0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7aa2aa-18e5-4756-87e6-1666f8d1cfcf]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d378a0bf-aae9-4e2a-b52d-12f2b170df73]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac11042-f362-4909-a58f-d49156f734ed]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9a5c03-a3e0-41fb-b474-2ac35665ee5b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a16e17-9bcd-4de9-957e-4b601a994b28]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260]
Nov 30 08:15:00 user nova-compute[74963]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036, portal: 172.16.0.220,3260] successful.
Nov 30 08:15:00 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0705d8a6-7d88-49a3-b0c9-341d67e1c036 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[91941cb2-ea77-4242-bd16-f5cf792da0f8]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] <== disconnect_volume: return (356ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:15:00 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Deleting instance files /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e_del
Nov 30 08:15:00 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Deletion of /opt/stack/data/nova/instances/3551893b-4a59-4e6a-a961-8ea6d671632e_del complete
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: INFO nova.compute.manager [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.252s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk 1073741824" returned: 0 in 0.050s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.195s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Cannot resize image /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Ensure instance console log exists: /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG nova.network.neutron [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Successfully created port: 3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-7715316f-8b41-4691-bdc0-9150d15ebb26 req-4725e3a9-bc72-4dab-9f1f-3081ef8f0607 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7715316f-8b41-4691-bdc0-9150d15ebb26 req-4725e3a9-bc72-4dab-9f1f-3081ef8f0607 service nova] Acquiring lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7715316f-8b41-4691-bdc0-9150d15ebb26 req-4725e3a9-bc72-4dab-9f1f-3081ef8f0607 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7715316f-8b41-4691-bdc0-9150d15ebb26 req-4725e3a9-bc72-4dab-9f1f-3081ef8f0607 service nova] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-7715316f-8b41-4691-bdc0-9150d15ebb26 req-4725e3a9-bc72-4dab-9f1f-3081ef8f0607 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] No waiting events found dispatching network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:01 user nova-compute[74963]: WARNING nova.compute.manager [req-7715316f-8b41-4691-bdc0-9150d15ebb26 req-4725e3a9-bc72-4dab-9f1f-3081ef8f0607 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received unexpected event network-vif-plugged-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 for instance with vm_state active and task_state deleting.
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:01 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:15:01 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Took 1.56 seconds to deallocate network for instance.
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Successfully updated port: 3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "refresh_cache-7c420b98-c113-4ce1-94e8-31e9e9525f67" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquired lock "refresh_cache-7c420b98-c113-4ce1-94e8-31e9e9525f67" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Updating instance_info_cache with network_info: [{"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Releasing lock "refresh_cache-7c420b98-c113-4ce1-94e8-31e9e9525f67" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Instance network_info: |[{"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Start _get_guest_xml network_info=[{"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:15:02 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:15:02 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-717755624',display_name='tempest-tempest.common.compute-instance-717755624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-717755624',id=21,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGhTzyuOSLvbt34DavgeYG1BIdcE+3bBbpAiBsIdXmjz1e75zxd6ooC/FD4AaX8M1mz3vKXEWbpVF0g6gA9lKzklv7j1uEVOsgCpOxYQS4sQ7noSFAhgsTV6eQwf1hyPA==',key_name='tempest-keypair-513063568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-miqeomp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=7c420b98-c113-4ce1-94e8-31e9e9525f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.objects.instance [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c420b98-c113-4ce1-94e8-31e9e9525f67 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:15:02 user nova-compute[74963]:   <uuid>7c420b98-c113-4ce1-94e8-31e9e9525f67</uuid>
Nov 30 08:15:02 user nova-compute[74963]:   <name>instance-00000015</name>
Nov 30 08:15:02 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:15:02 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:15:02 user nova-compute[74963]:   <metadata>
Nov 30 08:15:02 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:15:02 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:15:02 user nova-compute[74963]:       <nova:name>tempest-tempest.common.compute-instance-717755624</nova:name>
Nov 30 08:15:02 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:15:02</nova:creationTime>
Nov 30 08:15:02 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:15:02 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:15:02 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:15:02 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:15:02 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:15:02 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:15:02 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:15:02 user nova-compute[74963]:       <nova:owner>
Nov 30 08:15:02 user nova-compute[74963]:         <nova:user uuid="c803479aa87e4be79682975d47b7ccfd">tempest-ServerActionsTestOtherA-768867057-project-member</nova:user>
Nov 30 08:15:02 user nova-compute[74963]:         <nova:project uuid="e22db86fd7a54c5c9882623605de5608">tempest-ServerActionsTestOtherA-768867057</nova:project>
Nov 30 08:15:02 user nova-compute[74963]:       </nova:owner>
Nov 30 08:15:02 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:15:02 user nova-compute[74963]:       <nova:ports>
Nov 30 08:15:02 user nova-compute[74963]:         <nova:port uuid="3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1">
Nov 30 08:15:02 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 08:15:02 user nova-compute[74963]:         </nova:port>
Nov 30 08:15:02 user nova-compute[74963]:       </nova:ports>
Nov 30 08:15:02 user nova-compute[74963]:     </nova:instance>
Nov 30 08:15:02 user nova-compute[74963]:   </metadata>
Nov 30 08:15:02 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:15:02 user nova-compute[74963]:     <system>
Nov 30 08:15:02 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:15:02 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:15:02 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:15:02 user nova-compute[74963]:       <entry name="serial">7c420b98-c113-4ce1-94e8-31e9e9525f67</entry>
Nov 30 08:15:02 user nova-compute[74963]:       <entry name="uuid">7c420b98-c113-4ce1-94e8-31e9e9525f67</entry>
Nov 30 08:15:02 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:15:02 user nova-compute[74963]:     </system>
Nov 30 08:15:02 user nova-compute[74963]:   </sysinfo>
Nov 30 08:15:02 user nova-compute[74963]:   <os>
Nov 30 08:15:02 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:15:02 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:15:02 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:15:02 user nova-compute[74963]:   </os>
Nov 30 08:15:02 user nova-compute[74963]:   <features>
Nov 30 08:15:02 user nova-compute[74963]:     <acpi/>
Nov 30 08:15:02 user nova-compute[74963]:     <apic/>
Nov 30 08:15:02 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:15:02 user nova-compute[74963]:   </features>
Nov 30 08:15:02 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:15:02 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:15:02 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:15:02 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:15:02 user nova-compute[74963]:   </clock>
Nov 30 08:15:02 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:15:02 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:15:02 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:15:02 user nova-compute[74963]:   </cpu>
Nov 30 08:15:02 user nova-compute[74963]:   <devices>
Nov 30 08:15:02 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:15:02 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:15:02 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk"/>
Nov 30 08:15:02 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:15:02 user nova-compute[74963]:     </disk>
Nov 30 08:15:02 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:15:02 user nova-compute[74963]:       <mac address="fa:16:3e:b8:44:e8"/>
Nov 30 08:15:02 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:15:02 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:15:02 user nova-compute[74963]:       <target dev="tap3cae6733-e7"/>
Nov 30 08:15:02 user nova-compute[74963]:     </interface>
Nov 30 08:15:02 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:15:02 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/console.log" append="off"/>
Nov 30 08:15:02 user nova-compute[74963]:     </serial>
Nov 30 08:15:02 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:15:02 user nova-compute[74963]:     <video>
Nov 30 08:15:02 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:15:02 user nova-compute[74963]:     </video>
Nov 30 08:15:02 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:15:02 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:15:02 user nova-compute[74963]:     </rng>
Nov 30 08:15:02 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:15:02 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:15:02 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:15:02 user nova-compute[74963]:     </memballoon>
Nov 30 08:15:02 user nova-compute[74963]:   </devices>
Nov 30 08:15:02 user nova-compute[74963]: </domain>
Nov 30 08:15:02 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-717755624',display_name='tempest-tempest.common.compute-instance-717755624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-717755624',id=21,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGhTzyuOSLvbt34DavgeYG1BIdcE+3bBbpAiBsIdXmjz1e75zxd6ooC/FD4AaX8M1mz3vKXEWbpVF0g6gA9lKzklv7j1uEVOsgCpOxYQS4sQ7noSFAhgsTV6eQwf1hyPA==',key_name='tempest-keypair-513063568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-miqeomp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=7c420b98-c113-4ce1-94e8-31e9e9525f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG os_vif [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed14fa4e-bf3a-5555-8f4b-0b04e5895eb5', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cae6733-e7, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cae6733-e7, col_values=(('qos', UUID('efc788a9-1f5e-43b8-8ab4-a99d13cbc89d')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cae6733-e7, col_values=(('external_ids', {'iface-id': '3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:44:e8', 'vm-uuid': '7c420b98-c113-4ce1-94e8-31e9e9525f67'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:02 user nova-compute[74963]: INFO os_vif [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7')
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No VIF found with MAC fa:16:3e:b8:44:e8, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:15:02 user nova-compute[74963]: INFO nova.compute.manager [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Took 0.89 seconds to detach 1 volumes for instance.
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:03 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid '3551893b-4a59-4e6a-a961-8ea6d671632e' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid '3551893b-4a59-4e6a-a961-8ea6d671632e' (instance-00000001)
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:03 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Deleted allocations for instance 3551893b-4a59-4e6a-a961-8ea6d671632e
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2b86df15-aa5c-4230-b0aa-a13c511e7df7 tempest-ServerActionsTestOtherB-1961924021 tempest-ServerActionsTestOtherB-1961924021-project-member] Lock "3551893b-4a59-4e6a-a961-8ea6d671632e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.494s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-13181cb2-e1b1-462b-b4cf-a79dbd7143b1 req-b6e2ae94-3e82-4578-8660-8e41113c9e35 service nova] [instance: 3551893b-4a59-4e6a-a961-8ea6d671632e] Received event network-vif-deleted-9f867ffa-aeb8-4693-bce5-c4e507fad1a2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-13181cb2-e1b1-462b-b4cf-a79dbd7143b1 req-b6e2ae94-3e82-4578-8660-8e41113c9e35 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-changed-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-13181cb2-e1b1-462b-b4cf-a79dbd7143b1 req-b6e2ae94-3e82-4578-8660-8e41113c9e35 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Refreshing instance network info cache due to event network-changed-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13181cb2-e1b1-462b-b4cf-a79dbd7143b1 req-b6e2ae94-3e82-4578-8660-8e41113c9e35 service nova] Acquiring lock "refresh_cache-7c420b98-c113-4ce1-94e8-31e9e9525f67" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13181cb2-e1b1-462b-b4cf-a79dbd7143b1 req-b6e2ae94-3e82-4578-8660-8e41113c9e35 service nova] Acquired lock "refresh_cache-7c420b98-c113-4ce1-94e8-31e9e9525f67" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG nova.network.neutron [req-13181cb2-e1b1-462b-b4cf-a79dbd7143b1 req-b6e2ae94-3e82-4578-8660-8e41113c9e35 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Refreshing network info cache for port 3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-13181cb2-e1b1-462b-b4cf-a79dbd7143b1 req-b6e2ae94-3e82-4578-8660-8e41113c9e35 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Updated VIF entry in instance network info cache for port 3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:15:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-13181cb2-e1b1-462b-b4cf-a79dbd7143b1 req-b6e2ae94-3e82-4578-8660-8e41113c9e35 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Updating instance_info_cache with network_info: [{"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13181cb2-e1b1-462b-b4cf-a79dbd7143b1 req-b6e2ae94-3e82-4578-8660-8e41113c9e35 service nova] Releasing lock "refresh_cache-7c420b98-c113-4ce1-94e8-31e9e9525f67" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.compute.manager [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.compute.manager [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] No waiting events found dispatching network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:06 user nova-compute[74963]: WARNING nova.compute.manager [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received unexpected event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 for instance with vm_state building and task_state spawning.
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.compute.manager [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.compute.manager [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] No waiting events found dispatching network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:06 user nova-compute[74963]: WARNING nova.compute.manager [req-77ac64ec-b43a-4329-b57f-058d99814d51 req-2cd5068a-b507-4f83-a8e5-372e87ac76f7 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received unexpected event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 for instance with vm_state building and task_state spawning.
Nov 30 08:15:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Instance spawned successfully.
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:15:06 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:15:06 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7754MB free_disk=25.292648315429688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:15:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:15:07 user nova-compute[74963]: INFO nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 67d99f85-78de-4702-aa55-758173230187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance bb855029-8201-4c59-a4d2-3fac4a14fec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance fd313577-5b50-48f3-b224-68542b958d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9e48354e-9397-4305-914e-15a27651ea04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:15:07 user nova-compute[74963]: INFO nova.compute.manager [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Took 8.09 seconds to build instance.
Nov 30 08:15:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-29a0cfc7-620b-442e-a7ee-e571fadf7dc5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.205s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:15:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:15:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:15:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:15:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:15:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 67d99f85-78de-4702-aa55-758173230187] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:15:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating instance_info_cache with network_info: [{"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:15:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-67d99f85-78de-4702-aa55-758173230187" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:15:11 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 67d99f85-78de-4702-aa55-758173230187] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:15:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:15:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:15:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:15:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:15:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:15:11 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:15:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-82907550-c9fb-4cbc-9b63-06773ae37a4b req-a4c8841e-8f50-4210-918e-07dee99ca176 service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received event network-changed-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-82907550-c9fb-4cbc-9b63-06773ae37a4b req-a4c8841e-8f50-4210-918e-07dee99ca176 service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Refreshing instance network info cache due to event network-changed-af87f011-b963-479f-8d02-ed38ce604c3d. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82907550-c9fb-4cbc-9b63-06773ae37a4b req-a4c8841e-8f50-4210-918e-07dee99ca176 service nova] Acquiring lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82907550-c9fb-4cbc-9b63-06773ae37a4b req-a4c8841e-8f50-4210-918e-07dee99ca176 service nova] Acquired lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-82907550-c9fb-4cbc-9b63-06773ae37a4b req-a4c8841e-8f50-4210-918e-07dee99ca176 service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Refreshing network info cache for port af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-82907550-c9fb-4cbc-9b63-06773ae37a4b req-a4c8841e-8f50-4210-918e-07dee99ca176 service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Updated VIF entry in instance network info cache for port af87f011-b963-479f-8d02-ed38ce604c3d. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-82907550-c9fb-4cbc-9b63-06773ae37a4b req-a4c8841e-8f50-4210-918e-07dee99ca176 service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Updating instance_info_cache with network_info: [{"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG nova.objects.instance [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'flavor' on Instance uuid fd313577-5b50-48f3-b224-68542b958d21 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82907550-c9fb-4cbc-9b63-06773ae37a4b req-a4c8841e-8f50-4210-918e-07dee99ca176 service nova] Releasing lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:13 user nova-compute[74963]: INFO nova.compute.manager [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Attaching volume f628b4a5-9571-453b-b2c5-079961febffa to /dev/vdb
Nov 30 08:15:14 user nova-compute[74963]: DEBUG os_brick.utils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e2e3f5-9af1-4293-a996-30f139c47402]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eab6324-7ab9-48d8-aeb4-e0da20cac146]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b097737f-5df9-4e41-956a-c07668270ba1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0125d71-aaf7-4dc7-8d84-a56deb5770b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:15:14 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:15:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bdea0f-0a26-44ff-bbf4-319897710a4c]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG os_brick.utils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:15:14 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Updating existing volume attachment record: e7d39c4f-0caa-44cf-9cb5-18385187fb23 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:15:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHdSaIRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:15:22 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:15:22 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:15:22 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[79024906-8f70-4b3e-89f9-bda7536a50f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:15:22 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb1e98e-b488-4269-a3d4-44860936c7fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa] added
Nov 30 08:15:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[743fc3a7-18d5-4fed-b422-8a8fc8cd2115]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09c81b3-32ab-4c6c-af9b-eabec717f301]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHdSaIRn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHdSaIRn" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a592dd-2dee-4bf5-8baa-f239b990d987]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hHdSaIRn'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0ae1d5-6463-4e79-91c7-6f350e08b34f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35206e2-ddb1-450e-a4c9-af8a11f641e6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:15:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:15:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b78154-b412-4b28-8228-716788ceda9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa, portal: 172.16.0.220,3260]
Nov 30 08:15:22 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa, portal: 172.16.0.220,3260] successful.
Nov 30 08:15:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e04c7-2fe4-4f38-b980-7d00d3f60aba]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d511f56-6bb9-475d-bb8d-caae4cc705a0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:15:22 user nova-compute[74963]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa (non-flash)
Nov 30 08:15:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:15:22 user nova-compute[74963]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa (non-flash)
Nov 30 08:15:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[171bfa60-1e6c-48f3-b066-02815645c66b]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHdSaIRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "67d99f85-78de-4702-aa55-758173230187-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:22 user nova-compute[74963]: INFO nova.compute.manager [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Terminating instance
Nov 30 08:15:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-ad9fbd66-988a-40b4-b68f-5dffa2499fca req-eb5d3378-2e5b-494a-8cfb-710d10b9c544 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received event network-vif-unplugged-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ad9fbd66-988a-40b4-b68f-5dffa2499fca req-eb5d3378-2e5b-494a-8cfb-710d10b9c544 service nova] Acquiring lock "67d99f85-78de-4702-aa55-758173230187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ad9fbd66-988a-40b4-b68f-5dffa2499fca req-eb5d3378-2e5b-494a-8cfb-710d10b9c544 service nova] Lock "67d99f85-78de-4702-aa55-758173230187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ad9fbd66-988a-40b4-b68f-5dffa2499fca req-eb5d3378-2e5b-494a-8cfb-710d10b9c544 service nova] Lock "67d99f85-78de-4702-aa55-758173230187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-ad9fbd66-988a-40b4-b68f-5dffa2499fca req-eb5d3378-2e5b-494a-8cfb-710d10b9c544 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] No waiting events found dispatching network-vif-unplugged-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-ad9fbd66-988a-40b4-b68f-5dffa2499fca req-eb5d3378-2e5b-494a-8cfb-710d10b9c544 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received event network-vif-unplugged-53d952b1-3f88-45a5-9298-3d37b9335974 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26161353830333137', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161353830333137', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG nova.objects.instance [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'flavor' on Instance uuid fd313577-5b50-48f3-b224-68542b958d21 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:15:23 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:15:23 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:15:23 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:15:23 user nova-compute[74963]:   <serial>f628b4a5-9571-453b-b2c5-079961febffa</serial>
Nov 30 08:15:23 user nova-compute[74963]: </disk>
Nov 30 08:15:23 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:15:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:24 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 67d99f85-78de-4702-aa55-758173230187] Instance destroyed successfully.
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.objects.instance [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lazy-loading 'resources' on Instance uuid 67d99f85-78de-4702-aa55-758173230187 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-316819850',display_name='tempest-SnapshotDataIntegrityTests-server-316819850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-316819850',id=10,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3vuDCtEa1Plhn0HcBj0ArjNQrQT23hi/GFcg61YUdhljzG+/1uq68hZRArOxttUnSYNftHfwsUJn8XpWBm7pncT2UHfF2DOQomQM4ZgwNGQggPoMsnnWjAiHH0pXb7DQ==',key_name='tempest-keypair-314152562',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfe7a6cc402a4902ba3498b71ae52018',ramdisk_id='',reservation_id='r-vc46nq40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1083476417',owner_user_name='tempest-SnapshotDataIntegrityTests-1083476417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7d6cf12bef4415b2224ceb856b936f',uuid=67d99f85-78de-4702-aa55-758173230187,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Converting VIF {"id": "53d952b1-3f88-45a5-9298-3d37b9335974", "address": "fa:16:3e:e2:e7:00", "network": {"id": "ed0554b6-2198-4d86-83f6-71519e26610e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-505071078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfe7a6cc402a4902ba3498b71ae52018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d952b1-3f", "ovs_interfaceid": "53d952b1-3f88-45a5-9298-3d37b9335974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=53d952b1-3f88-45a5-9298-3d37b9335974,network=Network(ed0554b6-2198-4d86-83f6-71519e26610e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d952b1-3f') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG os_vif [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=53d952b1-3f88-45a5-9298-3d37b9335974,network=Network(ed0554b6-2198-4d86-83f6-71519e26610e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d952b1-3f') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53d952b1-3f, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f2bf03c-ce7c-489f-ae61-d9602c99fd33) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:15:24 user nova-compute[74963]: INFO os_vif [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=53d952b1-3f88-45a5-9298-3d37b9335974,network=Network(ed0554b6-2198-4d86-83f6-71519e26610e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d952b1-3f')
Nov 30 08:15:24 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Deleting instance files /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187_del
Nov 30 08:15:24 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Deletion of /opt/stack/data/nova/instances/67d99f85-78de-4702-aa55-758173230187_del complete
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No VIF found with MAC fa:16:3e:29:db:51, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:15:24 user nova-compute[74963]: INFO nova.compute.manager [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] [instance: 67d99f85-78de-4702-aa55-758173230187] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 30 08:15:24 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 67d99f85-78de-4702-aa55-758173230187] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 67d99f85-78de-4702-aa55-758173230187] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66a0a1a3-cd6f-4be4-abbe-cf46dce3e48d tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.349s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:15:24 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 67d99f85-78de-4702-aa55-758173230187] Took 0.81 seconds to deallocate network for instance.
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-3f85be19-5e6d-4a98-9277-58675f8505c3 req-bb93611a-1ab3-48b5-9ce5-71fe6fb3e1d4 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received event network-vif-deleted-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:24 user nova-compute[74963]: INFO nova.compute.manager [req-3f85be19-5e6d-4a98-9277-58675f8505c3 req-bb93611a-1ab3-48b5-9ce5-71fe6fb3e1d4 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Neutron deleted interface 53d952b1-3f88-45a5-9298-3d37b9335974; detaching it from the instance and deleting it from the info cache
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-3f85be19-5e6d-4a98-9277-58675f8505c3 req-bb93611a-1ab3-48b5-9ce5-71fe6fb3e1d4 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:15:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-3f85be19-5e6d-4a98-9277-58675f8505c3 req-bb93611a-1ab3-48b5-9ce5-71fe6fb3e1d4 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Detach interface failed, port_id=53d952b1-3f88-45a5-9298-3d37b9335974, reason: Instance 67d99f85-78de-4702-aa55-758173230187 could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:15:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-ae36b3df-fb7e-4f38-88ff-74a56d54d702 req-32b1d8dc-2dac-4d54-91be-3dcd51abddc5 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received event network-vif-plugged-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ae36b3df-fb7e-4f38-88ff-74a56d54d702 req-32b1d8dc-2dac-4d54-91be-3dcd51abddc5 service nova] Acquiring lock "67d99f85-78de-4702-aa55-758173230187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ae36b3df-fb7e-4f38-88ff-74a56d54d702 req-32b1d8dc-2dac-4d54-91be-3dcd51abddc5 service nova] Lock "67d99f85-78de-4702-aa55-758173230187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ae36b3df-fb7e-4f38-88ff-74a56d54d702 req-32b1d8dc-2dac-4d54-91be-3dcd51abddc5 service nova] Lock "67d99f85-78de-4702-aa55-758173230187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-ae36b3df-fb7e-4f38-88ff-74a56d54d702 req-32b1d8dc-2dac-4d54-91be-3dcd51abddc5 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] No waiting events found dispatching network-vif-plugged-53d952b1-3f88-45a5-9298-3d37b9335974 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:25 user nova-compute[74963]: WARNING nova.compute.manager [req-ae36b3df-fb7e-4f38-88ff-74a56d54d702 req-32b1d8dc-2dac-4d54-91be-3dcd51abddc5 service nova] [instance: 67d99f85-78de-4702-aa55-758173230187] Received unexpected event network-vif-plugged-53d952b1-3f88-45a5-9298-3d37b9335974 for instance with vm_state deleted and task_state None.
Nov 30 08:15:25 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:15:25 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:15:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:25 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Deleted allocations for instance 67d99f85-78de-4702-aa55-758173230187
Nov 30 08:15:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-42ad1366-5aae-49b1-94aa-bbcdb755dc42 tempest-SnapshotDataIntegrityTests-1083476417 tempest-SnapshotDataIntegrityTests-1083476417-project-member] Lock "67d99f85-78de-4702-aa55-758173230187" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:26 user nova-compute[74963]: INFO nova.compute.manager [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Detaching volume f628b4a5-9571-453b-b2c5-079961febffa
Nov 30 08:15:26 user nova-compute[74963]: INFO nova.virt.block_device [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Attempting to driver detach volume f628b4a5-9571-453b-b2c5-079961febffa from mountpoint /dev/vdb
Nov 30 08:15:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Attempting to detach device vdb from instance fd313577-5b50-48f3-b224-68542b958d21 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:15:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:15:26 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:15:26 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:15:26 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:15:26 user nova-compute[74963]:   <serial>f628b4a5-9571-453b-b2c5-079961febffa</serial>
Nov 30 08:15:26 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:15:26 user nova-compute[74963]: </disk>
Nov 30 08:15:26 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:15:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Successfully detached device vdb from instance fd313577-5b50-48f3-b224-68542b958d21 from the persistent domain config.
Nov 30 08:15:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd313577-5b50-48f3-b224-68542b958d21 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:15:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:15:26 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:15:26 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:15:26 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:15:26 user nova-compute[74963]:   <serial>f628b4a5-9571-453b-b2c5-079961febffa</serial>
Nov 30 08:15:26 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:15:26 user nova-compute[74963]: </disk>
Nov 30 08:15:26 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:15:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd313577-5b50-48f3-b224-68542b958d21 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:15:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "9e48354e-9397-4305-914e-15a27651ea04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "9e48354e-9397-4305-914e-15a27651ea04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "9e48354e-9397-4305-914e-15a27651ea04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:43 user nova-compute[74963]: INFO nova.compute.manager [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Terminating instance
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-84f146af-68a5-4683-8ed6-50baf085a61b req-be0a6110-e151-41ff-9a6e-fffb1487e0c6 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received event network-vif-unplugged-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-84f146af-68a5-4683-8ed6-50baf085a61b req-be0a6110-e151-41ff-9a6e-fffb1487e0c6 service nova] Acquiring lock "9e48354e-9397-4305-914e-15a27651ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-84f146af-68a5-4683-8ed6-50baf085a61b req-be0a6110-e151-41ff-9a6e-fffb1487e0c6 service nova] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-84f146af-68a5-4683-8ed6-50baf085a61b req-be0a6110-e151-41ff-9a6e-fffb1487e0c6 service nova] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-84f146af-68a5-4683-8ed6-50baf085a61b req-be0a6110-e151-41ff-9a6e-fffb1487e0c6 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] No waiting events found dispatching network-vif-unplugged-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-84f146af-68a5-4683-8ed6-50baf085a61b req-be0a6110-e151-41ff-9a6e-fffb1487e0c6 service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received event network-vif-unplugged-d65ca907-3ae7-470a-8b69-62622eb230f3 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Instance destroyed successfully.
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.objects.instance [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lazy-loading 'resources' on Instance uuid 9e48354e-9397-4305-914e-15a27651ea04 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1881772643',display_name='tempest-VolumesAdminNegativeTest-server-1881772643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1881772643',id=19,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a587ec45f21498ea140a9989398052e',ramdisk_id='',reservation_id='r-pldcoyh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1226639972',owner_user_name='tempest-VolumesAdminNegativeTest-1226639972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:13:53Z,user_data=None,user_id='85ae318785fd41ec87f9598fd18c593a',uuid=9e48354e-9397-4305-914e-15a27651ea04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converting VIF {"id": "d65ca907-3ae7-470a-8b69-62622eb230f3", "address": "fa:16:3e:1d:bd:be", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65ca907-3a", "ovs_interfaceid": "d65ca907-3ae7-470a-8b69-62622eb230f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bd:be,bridge_name='br-int',has_traffic_filtering=True,id=d65ca907-3ae7-470a-8b69-62622eb230f3,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65ca907-3a') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG os_vif [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bd:be,bridge_name='br-int',has_traffic_filtering=True,id=d65ca907-3ae7-470a-8b69-62622eb230f3,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65ca907-3a') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd65ca907-3a, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=071ba922-feaa-4649-baba-f04f20d8ecdd) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:43 user nova-compute[74963]: INFO os_vif [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bd:be,bridge_name='br-int',has_traffic_filtering=True,id=d65ca907-3ae7-470a-8b69-62622eb230f3,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65ca907-3a')
Nov 30 08:15:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Deleting instance files /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04_del
Nov 30 08:15:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Deletion of /opt/stack/data/nova/instances/9e48354e-9397-4305-914e-15a27651ea04_del complete
Nov 30 08:15:43 user nova-compute[74963]: INFO nova.compute.manager [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 30 08:15:43 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:15:43 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 9e48354e-9397-4305-914e-15a27651ea04] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:15:44 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:15:44 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Took 0.59 seconds to deallocate network for instance.
Nov 30 08:15:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:44 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:15:44 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:15:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:44 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Deleted allocations for instance 9e48354e-9397-4305-914e-15a27651ea04
Nov 30 08:15:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-205d842e-b18d-448f-bc56-ed6d0422de71 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "9e48354e-9397-4305-914e-15a27651ea04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.787s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-ead5f294-a668-4972-9bf3-458ca49f155e req-aba694c0-b5cf-41c4-9362-2ac3393c09ba service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received event network-vif-plugged-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ead5f294-a668-4972-9bf3-458ca49f155e req-aba694c0-b5cf-41c4-9362-2ac3393c09ba service nova] Acquiring lock "9e48354e-9397-4305-914e-15a27651ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ead5f294-a668-4972-9bf3-458ca49f155e req-aba694c0-b5cf-41c4-9362-2ac3393c09ba service nova] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ead5f294-a668-4972-9bf3-458ca49f155e req-aba694c0-b5cf-41c4-9362-2ac3393c09ba service nova] Lock "9e48354e-9397-4305-914e-15a27651ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-ead5f294-a668-4972-9bf3-458ca49f155e req-aba694c0-b5cf-41c4-9362-2ac3393c09ba service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] No waiting events found dispatching network-vif-plugged-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:45 user nova-compute[74963]: WARNING nova.compute.manager [req-ead5f294-a668-4972-9bf3-458ca49f155e req-aba694c0-b5cf-41c4-9362-2ac3393c09ba service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received unexpected event network-vif-plugged-d65ca907-3ae7-470a-8b69-62622eb230f3 for instance with vm_state deleted and task_state None.
Nov 30 08:15:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-ead5f294-a668-4972-9bf3-458ca49f155e req-aba694c0-b5cf-41c4-9362-2ac3393c09ba service nova] [instance: 9e48354e-9397-4305-914e-15a27651ea04] Received event network-vif-deleted-d65ca907-3ae7-470a-8b69-62622eb230f3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:46 user nova-compute[74963]: INFO nova.compute.manager [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Rescuing
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquired lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:15:46 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd313577-5b50-48f3-b224-68542b958d21 is timed out.
Nov 30 08:15:46 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Successfully detached device vdb from instance fd313577-5b50-48f3-b224-68542b958d21 from the live domain config.
Nov 30 08:15:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHdSaIRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:15:46 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8086e6-4f59-4d31-92ed-ac6eaac2404f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:15:46 user nova-compute[74963]: No targets found.
Nov 30 08:15:46 user nova-compute[74963]: iSNS:
Nov 30 08:15:46 user nova-compute[74963]: No targets found.
Nov 30 08:15:46 user nova-compute[74963]: STATIC:
Nov 30 08:15:46 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa
Nov 30 08:15:46 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:15:46 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:15:46 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:15:46 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:15:46 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:15:46 user nova-compute[74963]: FIRMWARE:
Nov 30 08:15:46 user nova-compute[74963]: No targets found.
Nov 30 08:15:46 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:15:46 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:15:46 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57989b3-e59d-4b8a-9734-f2dcdef3bd5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[067caeda-13d0-49fd-b12c-89509cf40ab2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:15:46 user nova-compute[74963]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa (non-flash)
Nov 30 08:15:46 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:15:46 user nova-compute[74963]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa (non-flash)
Nov 30 08:15:46 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62205d08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:15:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5c7cac-d550-4ace-8a09-63981a59bbaf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6d30a-36fe-49a7-9e29-b0addf83dee2]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[009e2048-ec69-4847-bba4-c18b6709bad4]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eefbc9d-16a9-4693-8840-8ccf66c0ed42]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac301cd-3316-4f6a-9e9e-bb25261e36f6]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca99b7ac-6b1d-4217-8ddd-32368cca573d]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa, portal: 172.16.0.220,3260]
Nov 30 08:15:47 user nova-compute[74963]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa, portal: 172.16.0.220,3260] successful.
Nov 30 08:15:47 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f628b4a5-9571-453b-b2c5-079961febffa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d2a1ec-b6fb-445a-9b15-8e04b68cbff2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] <== disconnect_volume: return (284ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updating instance_info_cache with network_info: [{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Releasing lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3c6feda-ce92-4f4f-ba49-7528d8da3d4d req-5268b154-d842-4e3a-8ac5-e70eeb72e4d4 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3c6feda-ce92-4f4f-ba49-7528d8da3d4d req-5268b154-d842-4e3a-8ac5-e70eeb72e4d4 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3c6feda-ce92-4f4f-ba49-7528d8da3d4d req-5268b154-d842-4e3a-8ac5-e70eeb72e4d4 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3c6feda-ce92-4f4f-ba49-7528d8da3d4d req-5268b154-d842-4e3a-8ac5-e70eeb72e4d4 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3c6feda-ce92-4f4f-ba49-7528d8da3d4d req-5268b154-d842-4e3a-8ac5-e70eeb72e4d4 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:47 user nova-compute[74963]: WARNING nova.compute.manager [req-e3c6feda-ce92-4f4f-ba49-7528d8da3d4d req-5268b154-d842-4e3a-8ac5-e70eeb72e4d4 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state rescuing.
Nov 30 08:15:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:47 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Instance destroyed successfully.
Nov 30 08:15:47 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Attempting rescue
Nov 30 08:15:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74963) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Instance directory exists: not creating {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 08:15:47 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Creating image(s)
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'trusted_certs' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'flavor' on Instance uuid fd313577-5b50-48f3-b224-68542b958d21 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18bbe928-5bdb-45e9-b12a-aaeddb26dd51 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.205s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue" returned: 0 in 0.051s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'migration_context' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.base [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<db76a4e1-46a1-4349-a21f-34d43d542349> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Start _get_guest_xml network_info=[{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "vif_mac": "fa:16:3e:44:b6:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'resources' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.base [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<db76a4e1-46a1-4349-a21f-34d43d542349> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'numa_topology' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.base [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<db76a4e1-46a1-4349-a21f-34d43d542349> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:15:48 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:15:48 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'vcpu_model' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.base [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<db76a4e1-46a1-4349-a21f-34d43d542349> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1360927833',display_name='tempest-ServerRescueNegativeTestJSON-server-1360927833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1360927833',id=15,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-0xtpfyjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:11:16Z,user_data=None,user_id='b068a21b7ee04d14984abc97e582aa63',uuid=db76a4e1-46a1-4349-a21f-34d43d542349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "vif_mac": "fa:16:3e:44:b6:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "vif_mac": "fa:16:3e:44:b6:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:b6:0d,bridge_name='br-int',has_traffic_filtering=True,id=214fb252-a1cd-4d60-9439-1a5b9f7e7a0b,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214fb252-a1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'pci_devices' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.objects.base [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<db76a4e1-46a1-4349-a21f-34d43d542349> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:15:48 user nova-compute[74963]:   <uuid>db76a4e1-46a1-4349-a21f-34d43d542349</uuid>
Nov 30 08:15:48 user nova-compute[74963]:   <name>instance-0000000f</name>
Nov 30 08:15:48 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:15:48 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:15:48 user nova-compute[74963]:   <metadata>
Nov 30 08:15:48 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:15:48 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:15:48 user nova-compute[74963]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1360927833</nova:name>
Nov 30 08:15:48 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:15:48</nova:creationTime>
Nov 30 08:15:48 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:15:48 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:15:48 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:15:48 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:15:48 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:15:48 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:15:48 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:15:48 user nova-compute[74963]:       <nova:owner>
Nov 30 08:15:48 user nova-compute[74963]:         <nova:user uuid="b068a21b7ee04d14984abc97e582aa63">tempest-ServerRescueNegativeTestJSON-1047810333-project-member</nova:user>
Nov 30 08:15:48 user nova-compute[74963]:         <nova:project uuid="c1d09678c8a049bca20bed732eedd231">tempest-ServerRescueNegativeTestJSON-1047810333</nova:project>
Nov 30 08:15:48 user nova-compute[74963]:       </nova:owner>
Nov 30 08:15:48 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:15:48 user nova-compute[74963]:       <nova:ports>
Nov 30 08:15:48 user nova-compute[74963]:         <nova:port uuid="214fb252-a1cd-4d60-9439-1a5b9f7e7a0b">
Nov 30 08:15:48 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 08:15:48 user nova-compute[74963]:         </nova:port>
Nov 30 08:15:48 user nova-compute[74963]:       </nova:ports>
Nov 30 08:15:48 user nova-compute[74963]:     </nova:instance>
Nov 30 08:15:48 user nova-compute[74963]:   </metadata>
Nov 30 08:15:48 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:15:48 user nova-compute[74963]:     <system>
Nov 30 08:15:48 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:15:48 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:15:48 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:15:48 user nova-compute[74963]:       <entry name="serial">db76a4e1-46a1-4349-a21f-34d43d542349</entry>
Nov 30 08:15:48 user nova-compute[74963]:       <entry name="uuid">db76a4e1-46a1-4349-a21f-34d43d542349</entry>
Nov 30 08:15:48 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:15:48 user nova-compute[74963]:     </system>
Nov 30 08:15:48 user nova-compute[74963]:   </sysinfo>
Nov 30 08:15:48 user nova-compute[74963]:   <os>
Nov 30 08:15:48 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:15:48 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:15:48 user nova-compute[74963]:   </os>
Nov 30 08:15:48 user nova-compute[74963]:   <features>
Nov 30 08:15:48 user nova-compute[74963]:     <acpi/>
Nov 30 08:15:48 user nova-compute[74963]:     <apic/>
Nov 30 08:15:48 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:15:48 user nova-compute[74963]:   </features>
Nov 30 08:15:48 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:15:48 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:15:48 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:15:48 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:15:48 user nova-compute[74963]:   </clock>
Nov 30 08:15:48 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:15:48 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:15:48 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:15:48 user nova-compute[74963]:   </cpu>
Nov 30 08:15:48 user nova-compute[74963]:   <devices>
Nov 30 08:15:48 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:15:48 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:15:48 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue"/>
Nov 30 08:15:48 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:15:48 user nova-compute[74963]:     </disk>
Nov 30 08:15:48 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:15:48 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:15:48 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk"/>
Nov 30 08:15:48 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:15:48 user nova-compute[74963]:     </disk>
Nov 30 08:15:48 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:15:48 user nova-compute[74963]:       <mac address="fa:16:3e:44:b6:0d"/>
Nov 30 08:15:48 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:15:48 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:15:48 user nova-compute[74963]:       <target dev="tap214fb252-a1"/>
Nov 30 08:15:48 user nova-compute[74963]:     </interface>
Nov 30 08:15:48 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:15:48 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/console.log" append="off"/>
Nov 30 08:15:48 user nova-compute[74963]:     </serial>
Nov 30 08:15:48 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:15:48 user nova-compute[74963]:     <video>
Nov 30 08:15:48 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:15:48 user nova-compute[74963]:     </video>
Nov 30 08:15:48 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:15:48 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:15:48 user nova-compute[74963]:     </rng>
Nov 30 08:15:48 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:15:48 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:15:48 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:15:48 user nova-compute[74963]:     </memballoon>
Nov 30 08:15:48 user nova-compute[74963]:   </devices>
Nov 30 08:15:48 user nova-compute[74963]: </domain>
Nov 30 08:15:48 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:15:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Instance destroyed successfully.
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No VIF found with MAC fa:16:3e:44:b6:0d, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:49 user nova-compute[74963]: WARNING nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state rescuing.
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:49 user nova-compute[74963]: WARNING nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state rescuing.
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:49 user nova-compute[74963]: WARNING nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state rescuing.
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:49 user nova-compute[74963]: WARNING nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state rescuing.
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:49 user nova-compute[74963]: WARNING nova.compute.manager [req-7e24371a-c3c6-42b8-9e8a-c4f0a7a99583 req-8fbf8202-5c24-4114-9103-e0966cb51396 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state rescuing.
Nov 30 08:15:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:51 user nova-compute[74963]: WARNING nova.compute.manager [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state rescuing.
Nov 30 08:15:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:15:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:15:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:15:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:15:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:15:51 user nova-compute[74963]: WARNING nova.compute.manager [req-bdea0bdb-0332-45de-b43d-f8cf41ed8020 req-008617ef-8cc8-44ac-be74-9cefe23535c6 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state rescuing.
Nov 30 08:15:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f571ca93-f62a-4c87-866f-a4f8e46815f9 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:15:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:15:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:16:02 user nova-compute[74963]: INFO nova.compute.claims [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Claim successful on node user
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:16:02 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG nova.policy [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faaefd1e3d946eba7123229378d79fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8be2ffbe2e411590d35d9c12196ba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:16:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Creating image(s)
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "/opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "/opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk 1073741824" returned: 0 in 0.047s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Successfully created port: af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Cannot resize image /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Ensure instance console log exists: /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Successfully updated port: af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquired lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-69b82516-0400-4a44-9de4-364e23d5b353 req-68ff6d16-1d7d-43a9-9a26-b02fbdd5de2a service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-changed-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-69b82516-0400-4a44-9de4-364e23d5b353 req-68ff6d16-1d7d-43a9-9a26-b02fbdd5de2a service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Refreshing instance network info cache due to event network-changed-af90eb0e-d1c3-4629-9d1a-1c224e637b11. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-69b82516-0400-4a44-9de4-364e23d5b353 req-68ff6d16-1d7d-43a9-9a26-b02fbdd5de2a service nova] Acquiring lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updating instance_info_cache with network_info: [{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Releasing lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance network_info: |[{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-69b82516-0400-4a44-9de4-364e23d5b353 req-68ff6d16-1d7d-43a9-9a26-b02fbdd5de2a service nova] Acquired lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.network.neutron [req-69b82516-0400-4a44-9de4-364e23d5b353 req-68ff6d16-1d7d-43a9-9a26-b02fbdd5de2a service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Refreshing network info cache for port af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Start _get_guest_xml network_info=[{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:16:05 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:16:05 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-947669859',display_name='tempest-AttachVolumeTestJSON-server-947669859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-947669859',id=22,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB89fVSzhtfwm1Lv4FTMQ2ggrdWdEmZEvTquBWG5boPgjeuHpCpNY7WcHKpOKqoOmBzQZB62F68xan1ZQtOg94hSbmIl0OyitqdcaGNNsJ2QLVnxkTze3FfA/yhI2bNjhg==',key_name='tempest-keypair-1328476592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-ls2r7c4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=ddde2d1c-aa4e-4415-ab80-6c5e217aae37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.objects.instance [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'pci_devices' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:16:05 user nova-compute[74963]:   <uuid>ddde2d1c-aa4e-4415-ab80-6c5e217aae37</uuid>
Nov 30 08:16:05 user nova-compute[74963]:   <name>instance-00000016</name>
Nov 30 08:16:05 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:16:05 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:16:05 user nova-compute[74963]:   <metadata>
Nov 30 08:16:05 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:16:05 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:16:05 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeTestJSON-server-947669859</nova:name>
Nov 30 08:16:05 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:16:05</nova:creationTime>
Nov 30 08:16:05 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:16:05 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:16:05 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:16:05 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:16:05 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:16:05 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:16:05 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:16:05 user nova-compute[74963]:       <nova:owner>
Nov 30 08:16:05 user nova-compute[74963]:         <nova:user uuid="5faaefd1e3d946eba7123229378d79fe">tempest-AttachVolumeTestJSON-1519701713-project-member</nova:user>
Nov 30 08:16:05 user nova-compute[74963]:         <nova:project uuid="df8be2ffbe2e411590d35d9c12196ba8">tempest-AttachVolumeTestJSON-1519701713</nova:project>
Nov 30 08:16:05 user nova-compute[74963]:       </nova:owner>
Nov 30 08:16:05 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:16:05 user nova-compute[74963]:       <nova:ports>
Nov 30 08:16:05 user nova-compute[74963]:         <nova:port uuid="af90eb0e-d1c3-4629-9d1a-1c224e637b11">
Nov 30 08:16:05 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 08:16:05 user nova-compute[74963]:         </nova:port>
Nov 30 08:16:05 user nova-compute[74963]:       </nova:ports>
Nov 30 08:16:05 user nova-compute[74963]:     </nova:instance>
Nov 30 08:16:05 user nova-compute[74963]:   </metadata>
Nov 30 08:16:05 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:16:05 user nova-compute[74963]:     <system>
Nov 30 08:16:05 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:16:05 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:16:05 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:16:05 user nova-compute[74963]:       <entry name="serial">ddde2d1c-aa4e-4415-ab80-6c5e217aae37</entry>
Nov 30 08:16:05 user nova-compute[74963]:       <entry name="uuid">ddde2d1c-aa4e-4415-ab80-6c5e217aae37</entry>
Nov 30 08:16:05 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:16:05 user nova-compute[74963]:     </system>
Nov 30 08:16:05 user nova-compute[74963]:   </sysinfo>
Nov 30 08:16:05 user nova-compute[74963]:   <os>
Nov 30 08:16:05 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:16:05 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:16:05 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:16:05 user nova-compute[74963]:   </os>
Nov 30 08:16:05 user nova-compute[74963]:   <features>
Nov 30 08:16:05 user nova-compute[74963]:     <acpi/>
Nov 30 08:16:05 user nova-compute[74963]:     <apic/>
Nov 30 08:16:05 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:16:05 user nova-compute[74963]:   </features>
Nov 30 08:16:05 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:16:05 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:16:05 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:16:05 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:16:05 user nova-compute[74963]:   </clock>
Nov 30 08:16:05 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:16:05 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:16:05 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:16:05 user nova-compute[74963]:   </cpu>
Nov 30 08:16:05 user nova-compute[74963]:   <devices>
Nov 30 08:16:05 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:16:05 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:16:05 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk"/>
Nov 30 08:16:05 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:16:05 user nova-compute[74963]:     </disk>
Nov 30 08:16:05 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:16:05 user nova-compute[74963]:       <mac address="fa:16:3e:c2:ee:25"/>
Nov 30 08:16:05 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:16:05 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:16:05 user nova-compute[74963]:       <target dev="tapaf90eb0e-d1"/>
Nov 30 08:16:05 user nova-compute[74963]:     </interface>
Nov 30 08:16:05 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:16:05 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/console.log" append="off"/>
Nov 30 08:16:05 user nova-compute[74963]:     </serial>
Nov 30 08:16:05 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:16:05 user nova-compute[74963]:     <video>
Nov 30 08:16:05 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:16:05 user nova-compute[74963]:     </video>
Nov 30 08:16:05 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:16:05 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:16:05 user nova-compute[74963]:     </rng>
Nov 30 08:16:05 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:16:05 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:16:05 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:16:05 user nova-compute[74963]:     </memballoon>
Nov 30 08:16:05 user nova-compute[74963]:   </devices>
Nov 30 08:16:05 user nova-compute[74963]: </domain>
Nov 30 08:16:05 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-947669859',display_name='tempest-AttachVolumeTestJSON-server-947669859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-947669859',id=22,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB89fVSzhtfwm1Lv4FTMQ2ggrdWdEmZEvTquBWG5boPgjeuHpCpNY7WcHKpOKqoOmBzQZB62F68xan1ZQtOg94hSbmIl0OyitqdcaGNNsJ2QLVnxkTze3FfA/yhI2bNjhg==',key_name='tempest-keypair-1328476592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-ls2r7c4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=ddde2d1c-aa4e-4415-ab80-6c5e217aae37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG os_vif [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '953b5a5c-8a12-557b-b081-a3cce09a10e5', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf90eb0e-d1, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf90eb0e-d1, col_values=(('qos', UUID('8f6d9693-6387-436d-b352-86fc09eda026')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf90eb0e-d1, col_values=(('external_ids', {'iface-id': 'af90eb0e-d1c3-4629-9d1a-1c224e637b11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:ee:25', 'vm-uuid': 'ddde2d1c-aa4e-4415-ab80-6c5e217aae37'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:05 user nova-compute[74963]: INFO os_vif [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1')
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No VIF found with MAC fa:16:3e:c2:ee:25, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.network.neutron [req-69b82516-0400-4a44-9de4-364e23d5b353 req-68ff6d16-1d7d-43a9-9a26-b02fbdd5de2a service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updated VIF entry in instance network info cache for port af90eb0e-d1c3-4629-9d1a-1c224e637b11. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG nova.network.neutron [req-69b82516-0400-4a44-9de4-364e23d5b353 req-68ff6d16-1d7d-43a9-9a26-b02fbdd5de2a service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updating instance_info_cache with network_info: [{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-69b82516-0400-4a44-9de4-364e23d5b353 req-68ff6d16-1d7d-43a9-9a26-b02fbdd5de2a service nova] Releasing lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-fd23835b-c1af-4c38-93b0-dcdafe90e4a7 req-fbcee59f-f943-4a53-9528-a9009d1e19ba service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fd23835b-c1af-4c38-93b0-dcdafe90e4a7 req-fbcee59f-f943-4a53-9528-a9009d1e19ba service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fd23835b-c1af-4c38-93b0-dcdafe90e4a7 req-fbcee59f-f943-4a53-9528-a9009d1e19ba service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fd23835b-c1af-4c38-93b0-dcdafe90e4a7 req-fbcee59f-f943-4a53-9528-a9009d1e19ba service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-fd23835b-c1af-4c38-93b0-dcdafe90e4a7 req-fbcee59f-f943-4a53-9528-a9009d1e19ba service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:16:09 user nova-compute[74963]: WARNING nova.compute.manager [req-fd23835b-c1af-4c38-93b0-dcdafe90e4a7 req-fbcee59f-f943-4a53-9528-a9009d1e19ba service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state building and task_state spawning.
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-645ca23b-5731-4876-bd5a-9391be6a3106 req-62baacb2-fc92-4963-bb55-d84651e2569d service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-645ca23b-5731-4876-bd5a-9391be6a3106 req-62baacb2-fc92-4963-bb55-d84651e2569d service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-645ca23b-5731-4876-bd5a-9391be6a3106 req-62baacb2-fc92-4963-bb55-d84651e2569d service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-645ca23b-5731-4876-bd5a-9391be6a3106 req-62baacb2-fc92-4963-bb55-d84651e2569d service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-645ca23b-5731-4876-bd5a-9391be6a3106 req-62baacb2-fc92-4963-bb55-d84651e2569d service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:16:09 user nova-compute[74963]: WARNING nova.compute.manager [req-645ca23b-5731-4876-bd5a-9391be6a3106 req-62baacb2-fc92-4963-bb55-d84651e2569d service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state building and task_state spawning.
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:09 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:16:09 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7774MB free_disk=25.341888427734375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:09 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance spawned successfully.
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:09 user nova-compute[74963]: INFO nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance bb855029-8201-4c59-a4d2-3fac4a14fec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance fd313577-5b50-48f3-b224-68542b958d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1528211a-3b92-46aa-8512-5c2568f361ea has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:16:09 user nova-compute[74963]: INFO nova.compute.manager [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Took 7.28 seconds to build instance.
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ae-e3c4-4df7-b840-409b0dcc0db5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.475s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.461s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:09 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:16:09 user nova-compute[74963]: INFO nova.compute.claims [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Claim successful on node user
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:16:10 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.policy [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3f051de260047f8af5e1cc872e4ae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013793585eb2493d80b2bd27e64c4471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:16:10 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Creating image(s)
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.222s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk 1073741824" returned: 0 in 0.051s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Successfully created port: f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Cannot resize image /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Ensure instance console log exists: /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updating instance_info_cache with network_info: [{"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:11 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Successfully updated port: f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquired lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-a05a9e5a-68d4-4a5e-9dc9-818a370424ff req-35d2f62e-20df-425b-bb61-6d523f4f2300 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-changed-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-a05a9e5a-68d4-4a5e-9dc9-818a370424ff req-35d2f62e-20df-425b-bb61-6d523f4f2300 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Refreshing instance network info cache due to event network-changed-f76abde2-a558-4cba-a95d-959ac47f8746. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a05a9e5a-68d4-4a5e-9dc9-818a370424ff req-35d2f62e-20df-425b-bb61-6d523f4f2300 service nova] Acquiring lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating instance_info_cache with network_info: [{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Releasing lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Instance network_info: |[{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a05a9e5a-68d4-4a5e-9dc9-818a370424ff req-35d2f62e-20df-425b-bb61-6d523f4f2300 service nova] Acquired lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.network.neutron [req-a05a9e5a-68d4-4a5e-9dc9-818a370424ff req-35d2f62e-20df-425b-bb61-6d523f4f2300 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Refreshing network info cache for port f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Start _get_guest_xml network_info=[{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:16:12 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:16:12 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-276068840',display_name='tempest-ServerStableDeviceRescueTest-server-276068840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-276068840',id=23,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE40jvwvsDQoaQ3t8TBNrzK6XW0OcvTn7nok9F/lP8HPBvrXhsdZBe+FtRUWZI/eJhWClnJvORdzk45IuI0V2vZfiANVF9lPL6ESNpM6LHAjFUbsb0BnY1YF/tvKV3F7SA==',key_name='tempest-keypair-1057764945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='013793585eb2493d80b2bd27e64c4471',ramdisk_id='',reservation_id='r-x2r2tcfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1608184284',owner_user_name='tempest-ServerStableDeviceRescueTest-1608184284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f051de260047f8af5e1cc872e4ae80',uuid=1528211a-3b92-46aa-8512-5c2568f361ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Converting VIF {"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d5:1c,bridge_name='br-int',has_traffic_filtering=True,id=f76abde2-a558-4cba-a95d-959ac47f8746,network=Network(3070ea18-ada1-4d74-bf4f-9d95958aec61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76abde2-a5') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.objects.instance [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'pci_devices' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:16:12 user nova-compute[74963]:   <uuid>1528211a-3b92-46aa-8512-5c2568f361ea</uuid>
Nov 30 08:16:12 user nova-compute[74963]:   <name>instance-00000017</name>
Nov 30 08:16:12 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:16:12 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:16:12 user nova-compute[74963]:   <metadata>
Nov 30 08:16:12 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:16:12 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:16:12 user nova-compute[74963]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-276068840</nova:name>
Nov 30 08:16:12 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:16:12</nova:creationTime>
Nov 30 08:16:12 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:16:12 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:16:12 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:16:12 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:16:12 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:16:12 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:16:12 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:16:12 user nova-compute[74963]:       <nova:owner>
Nov 30 08:16:12 user nova-compute[74963]:         <nova:user uuid="e3f051de260047f8af5e1cc872e4ae80">tempest-ServerStableDeviceRescueTest-1608184284-project-member</nova:user>
Nov 30 08:16:12 user nova-compute[74963]:         <nova:project uuid="013793585eb2493d80b2bd27e64c4471">tempest-ServerStableDeviceRescueTest-1608184284</nova:project>
Nov 30 08:16:12 user nova-compute[74963]:       </nova:owner>
Nov 30 08:16:12 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:16:12 user nova-compute[74963]:       <nova:ports>
Nov 30 08:16:12 user nova-compute[74963]:         <nova:port uuid="f76abde2-a558-4cba-a95d-959ac47f8746">
Nov 30 08:16:12 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 08:16:12 user nova-compute[74963]:         </nova:port>
Nov 30 08:16:12 user nova-compute[74963]:       </nova:ports>
Nov 30 08:16:12 user nova-compute[74963]:     </nova:instance>
Nov 30 08:16:12 user nova-compute[74963]:   </metadata>
Nov 30 08:16:12 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:16:12 user nova-compute[74963]:     <system>
Nov 30 08:16:12 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:16:12 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:16:12 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:16:12 user nova-compute[74963]:       <entry name="serial">1528211a-3b92-46aa-8512-5c2568f361ea</entry>
Nov 30 08:16:12 user nova-compute[74963]:       <entry name="uuid">1528211a-3b92-46aa-8512-5c2568f361ea</entry>
Nov 30 08:16:12 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:16:12 user nova-compute[74963]:     </system>
Nov 30 08:16:12 user nova-compute[74963]:   </sysinfo>
Nov 30 08:16:12 user nova-compute[74963]:   <os>
Nov 30 08:16:12 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:16:12 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:16:12 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:16:12 user nova-compute[74963]:   </os>
Nov 30 08:16:12 user nova-compute[74963]:   <features>
Nov 30 08:16:12 user nova-compute[74963]:     <acpi/>
Nov 30 08:16:12 user nova-compute[74963]:     <apic/>
Nov 30 08:16:12 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:16:12 user nova-compute[74963]:   </features>
Nov 30 08:16:12 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:16:12 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:16:12 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:16:12 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:16:12 user nova-compute[74963]:   </clock>
Nov 30 08:16:12 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:16:12 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:16:12 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:16:12 user nova-compute[74963]:   </cpu>
Nov 30 08:16:12 user nova-compute[74963]:   <devices>
Nov 30 08:16:12 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:16:12 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:16:12 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk"/>
Nov 30 08:16:12 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:16:12 user nova-compute[74963]:     </disk>
Nov 30 08:16:12 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:16:12 user nova-compute[74963]:       <mac address="fa:16:3e:ed:d5:1c"/>
Nov 30 08:16:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:16:12 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:16:12 user nova-compute[74963]:       <target dev="tapf76abde2-a5"/>
Nov 30 08:16:12 user nova-compute[74963]:     </interface>
Nov 30 08:16:12 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:16:12 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/console.log" append="off"/>
Nov 30 08:16:12 user nova-compute[74963]:     </serial>
Nov 30 08:16:12 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:16:12 user nova-compute[74963]:     <video>
Nov 30 08:16:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:16:12 user nova-compute[74963]:     </video>
Nov 30 08:16:12 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:16:12 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:16:12 user nova-compute[74963]:     </rng>
Nov 30 08:16:12 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:16:12 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:16:12 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:16:12 user nova-compute[74963]:     </memballoon>
Nov 30 08:16:12 user nova-compute[74963]:   </devices>
Nov 30 08:16:12 user nova-compute[74963]: </domain>
Nov 30 08:16:12 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-276068840',display_name='tempest-ServerStableDeviceRescueTest-server-276068840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-276068840',id=23,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE40jvwvsDQoaQ3t8TBNrzK6XW0OcvTn7nok9F/lP8HPBvrXhsdZBe+FtRUWZI/eJhWClnJvORdzk45IuI0V2vZfiANVF9lPL6ESNpM6LHAjFUbsb0BnY1YF/tvKV3F7SA==',key_name='tempest-keypair-1057764945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='013793585eb2493d80b2bd27e64c4471',ramdisk_id='',reservation_id='r-x2r2tcfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1608184284',owner_user_name='tempest-ServerStableDeviceRescueTest-1608184284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f051de260047f8af5e1cc872e4ae80',uuid=1528211a-3b92-46aa-8512-5c2568f361ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Converting VIF {"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d5:1c,bridge_name='br-int',has_traffic_filtering=True,id=f76abde2-a558-4cba-a95d-959ac47f8746,network=Network(3070ea18-ada1-4d74-bf4f-9d95958aec61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76abde2-a5') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG os_vif [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d5:1c,bridge_name='br-int',has_traffic_filtering=True,id=f76abde2-a558-4cba-a95d-959ac47f8746,network=Network(3070ea18-ada1-4d74-bf4f-9d95958aec61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76abde2-a5') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f11bf3d-1cf6-5ddd-99cd-a2606c9356fe', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf76abde2-a5, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf76abde2-a5, col_values=(('qos', UUID('6153de8e-85ed-4aff-bef3-9b16dcd68e55')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf76abde2-a5, col_values=(('external_ids', {'iface-id': 'f76abde2-a558-4cba-a95d-959ac47f8746', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:d5:1c', 'vm-uuid': '1528211a-3b92-46aa-8512-5c2568f361ea'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:12 user nova-compute[74963]: INFO os_vif [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d5:1c,bridge_name='br-int',has_traffic_filtering=True,id=f76abde2-a558-4cba-a95d-959ac47f8746,network=Network(3070ea18-ada1-4d74-bf4f-9d95958aec61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76abde2-a5')
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:16:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] No VIF found with MAC fa:16:3e:ed:d5:1c, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:16:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-a05a9e5a-68d4-4a5e-9dc9-818a370424ff req-35d2f62e-20df-425b-bb61-6d523f4f2300 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updated VIF entry in instance network info cache for port f76abde2-a558-4cba-a95d-959ac47f8746. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:16:13 user nova-compute[74963]: DEBUG nova.network.neutron [req-a05a9e5a-68d4-4a5e-9dc9-818a370424ff req-35d2f62e-20df-425b-bb61-6d523f4f2300 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating instance_info_cache with network_info: [{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:16:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a05a9e5a-68d4-4a5e-9dc9-818a370424ff req-35d2f62e-20df-425b-bb61-6d523f4f2300 service nova] Releasing lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:16:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-1ebe7e29-efbe-4bd5-a0f0-8bfc6bd41d62 req-2d9e666b-5e35-4e92-b682-6783a30ee6b9 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1ebe7e29-efbe-4bd5-a0f0-8bfc6bd41d62 req-2d9e666b-5e35-4e92-b682-6783a30ee6b9 service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1ebe7e29-efbe-4bd5-a0f0-8bfc6bd41d62 req-2d9e666b-5e35-4e92-b682-6783a30ee6b9 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1ebe7e29-efbe-4bd5-a0f0-8bfc6bd41d62 req-2d9e666b-5e35-4e92-b682-6783a30ee6b9 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-1ebe7e29-efbe-4bd5-a0f0-8bfc6bd41d62 req-2d9e666b-5e35-4e92-b682-6783a30ee6b9 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:16:14 user nova-compute[74963]: WARNING nova.compute.manager [req-1ebe7e29-efbe-4bd5-a0f0-8bfc6bd41d62 req-2d9e666b-5e35-4e92-b682-6783a30ee6b9 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state building and task_state spawning.
Nov 30 08:16:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:16:16 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Instance spawned successfully.
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:16 user nova-compute[74963]: INFO nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-8b432a4a-c7a1-47f8-a9d1-6fd1423e64b5 req-abc82326-25c3-4d67-99e1-b46cfce78a9d service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8b432a4a-c7a1-47f8-a9d1-6fd1423e64b5 req-abc82326-25c3-4d67-99e1-b46cfce78a9d service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8b432a4a-c7a1-47f8-a9d1-6fd1423e64b5 req-abc82326-25c3-4d67-99e1-b46cfce78a9d service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8b432a4a-c7a1-47f8-a9d1-6fd1423e64b5 req-abc82326-25c3-4d67-99e1-b46cfce78a9d service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-8b432a4a-c7a1-47f8-a9d1-6fd1423e64b5 req-abc82326-25c3-4d67-99e1-b46cfce78a9d service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:16:16 user nova-compute[74963]: WARNING nova.compute.manager [req-8b432a4a-c7a1-47f8-a9d1-6fd1423e64b5 req-abc82326-25c3-4d67-99e1-b46cfce78a9d service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state building and task_state spawning.
Nov 30 08:16:16 user nova-compute[74963]: INFO nova.compute.manager [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Took 7.40 seconds to build instance.
Nov 30 08:16:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3601a17b-7bbb-47c6-a57c-194baf9e12b6 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.510s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:16:22 user nova-compute[74963]: INFO nova.compute.manager [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] instance snapshotting
Nov 30 08:16:22 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Beginning live snapshot process
Nov 30 08:16:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json -f qcow2 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json -f qcow2 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:22 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv64c4yf8/f9b98164ed7843f3b8a0c2ae5300c90e.delta 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv64c4yf8/f9b98164ed7843f3b8a0c2ae5300c90e.delta 1073741824" returned: 0 in 0.067s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:23 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 08:16:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:16:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:16:24 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 08:16:24 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:16:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv64c4yf8/f9b98164ed7843f3b8a0c2ae5300c90e.delta /opt/stack/data/nova/instances/snapshots/tmpv64c4yf8/f9b98164ed7843f3b8a0c2ae5300c90e {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv64c4yf8/f9b98164ed7843f3b8a0c2ae5300c90e.delta /opt/stack/data/nova/instances/snapshots/tmpv64c4yf8/f9b98164ed7843f3b8a0c2ae5300c90e" returned: 0 in 0.427s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:24 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Snapshot extracted, beginning image upload
Nov 30 08:16:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Snapshot image upload complete
Nov 30 08:16:27 user nova-compute[74963]: INFO nova.compute.manager [None req-ed3389c2-7b42-464b-9c42-f017469f11d7 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Took 5.10 seconds to snapshot the instance on the hypervisor.
Nov 30 08:16:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:16:29 user nova-compute[74963]: INFO nova.compute.claims [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Claim successful on node user
Nov 30 08:16:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:16:29 user nova-compute[74963]: INFO nova.compute.manager [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] instance snapshotting
Nov 30 08:16:29 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:16:29 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Beginning live snapshot process
Nov 30 08:16:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:16:29 user nova-compute[74963]: DEBUG nova.network.neutron [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:16:30 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:16:30 user nova-compute[74963]: DEBUG nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:16:30 user nova-compute[74963]: DEBUG nova.policy [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0406077bdf143258a2d84290bb449da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa068a8025245e0aa581bfad0b5c324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:16:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json -f qcow2 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:30 user nova-compute[74963]: DEBUG nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:16:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:16:30 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Creating image(s)
Nov 30 08:16:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "/opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "/opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "b17ffe2c2b54f69a8017559d6214218fd7925428" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "b17ffe2c2b54f69a8017559d6214218fd7925428" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428.part --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG nova.network.neutron [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Successfully created port: ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json -f qcow2" returned: 0 in 1.100s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json -f qcow2 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG nova.virt.images [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] 4f3508e6-5f58-445c-adc0-78fbfdaf19b9 was qcow2, converting to raw {{(pid=74963) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428.part /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428.converted {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json -f qcow2" returned: 0 in 0.240s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.209s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplwdt6ulh/360ba52e37b74dc78240afd5549bc6d3.delta 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplwdt6ulh/360ba52e37b74dc78240afd5549bc6d3.delta 1073741824" returned: 0 in 0.261s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:31 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428.part /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428.converted" returned: 0 in 0.667s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428.converted --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.network.neutron [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Successfully updated port: ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquired lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.network.neutron [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "b17ffe2c2b54f69a8017559d6214218fd7925428" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.125s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.compute.manager [req-83a9aa5e-d166-41d9-acbe-127a96bd7e4d req-e966df18-b95e-4b2f-ac7f-4bc78bf5c954 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received event network-changed-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.compute.manager [req-83a9aa5e-d166-41d9-acbe-127a96bd7e4d req-e966df18-b95e-4b2f-ac7f-4bc78bf5c954 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Refreshing instance network info cache due to event network-changed-ff3a0512-18ba-45c2-b1a4-7137ad1ac421. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-83a9aa5e-d166-41d9-acbe-127a96bd7e4d req-e966df18-b95e-4b2f-ac7f-4bc78bf5c954 service nova] Acquiring lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.network.neutron [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428 --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "b17ffe2c2b54f69a8017559d6214218fd7925428" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "b17ffe2c2b54f69a8017559d6214218fd7925428" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428 --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428,backing_fmt=raw /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.network.neutron [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Updating instance_info_cache with network_info: [{"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428,backing_fmt=raw /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk 1073741824" returned: 0 in 0.045s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "b17ffe2c2b54f69a8017559d6214218fd7925428" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Releasing lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Instance network_info: |[{"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-83a9aa5e-d166-41d9-acbe-127a96bd7e4d req-e966df18-b95e-4b2f-ac7f-4bc78bf5c954 service nova] Acquired lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.network.neutron [req-83a9aa5e-d166-41d9-acbe-127a96bd7e4d req-e966df18-b95e-4b2f-ac7f-4bc78bf5c954 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Refreshing network info cache for port ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] COPY block job progress, current cursor: 1638400 final cursor: 75497472 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17ffe2c2b54f69a8017559d6214218fd7925428 --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Ensure instance console log exists: /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Start _get_guest_xml network_info=[{"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5c519d1a3c431f7022436e1dcd49f27d',container_format='bare',created_at=2023-11-30T08:16:22Z,direct_url=<?>,disk_format='qcow2',id=4f3508e6-5f58-445c-adc0-78fbfdaf19b9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1383706984',owner='9fa068a8025245e0aa581bfad0b5c324',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T08:16:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': '4f3508e6-5f58-445c-adc0-78fbfdaf19b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:16:32 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:16:32 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5c519d1a3c431f7022436e1dcd49f27d',container_format='bare',created_at=2023-11-30T08:16:22Z,direct_url=<?>,disk_format='qcow2',id=4f3508e6-5f58-445c-adc0-78fbfdaf19b9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1383706984',owner='9fa068a8025245e0aa581bfad0b5c324',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T08:16:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:16:32 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1658909138',display_name='tempest-TestStampPattern-server-1658909138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1658909138',id=24,image_ref='4f3508e6-5f58-445c-adc0-78fbfdaf19b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXIfFHcf5hZJI1eOXWVSrzGJVOsClL3sRsQglOYWvzxqFcx/NwLGZqv1l34N2xD8aFbH1Lm1nfJS/HKaYuBZq5gxNl5qlH94PvOr+veB7phGIVgZOlhO4hSirM+QIZFUw==',key_name='tempest-TestStampPattern-1283092476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fa068a8025245e0aa581bfad0b5c324',ramdisk_id='',reservation_id='r-4xvjtsma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fd313577-5b50-48f3-b224-68542b958d21',image_min_disk='1',image_min_ram='0',image_owner_id='9fa068a8025245e0aa581bfad0b5c324',image_owner_project_name='tempest-TestStampPattern-14898091',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-14898091-project-member',image_user_id='a0406077bdf143258a2d84290bb449da',network_allocated='True',owner_project_name='tempest-TestStampPattern-14898091',owner_user_name='tempest-TestStampPattern-14898091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:16:30Z,user_data=None,user_id='a0406077bdf143258a2d84290bb449da',uuid=f4db2f97-c674-4da7-91d8-ed10cf4c964a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converting VIF {"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:be:4d,bridge_name='br-int',has_traffic_filtering=True,id=ff3a0512-18ba-45c2-b1a4-7137ad1ac421,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3a0512-18') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.objects.instance [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'pci_devices' on Instance uuid f4db2f97-c674-4da7-91d8-ed10cf4c964a {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:16:33 user nova-compute[74963]:   <uuid>f4db2f97-c674-4da7-91d8-ed10cf4c964a</uuid>
Nov 30 08:16:33 user nova-compute[74963]:   <name>instance-00000018</name>
Nov 30 08:16:33 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:16:33 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:16:33 user nova-compute[74963]:   <metadata>
Nov 30 08:16:33 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:16:33 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:16:33 user nova-compute[74963]:       <nova:name>tempest-TestStampPattern-server-1658909138</nova:name>
Nov 30 08:16:33 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:16:32</nova:creationTime>
Nov 30 08:16:33 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:16:33 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:16:33 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:16:33 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:16:33 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:16:33 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:16:33 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:16:33 user nova-compute[74963]:       <nova:owner>
Nov 30 08:16:33 user nova-compute[74963]:         <nova:user uuid="a0406077bdf143258a2d84290bb449da">tempest-TestStampPattern-14898091-project-member</nova:user>
Nov 30 08:16:33 user nova-compute[74963]:         <nova:project uuid="9fa068a8025245e0aa581bfad0b5c324">tempest-TestStampPattern-14898091</nova:project>
Nov 30 08:16:33 user nova-compute[74963]:       </nova:owner>
Nov 30 08:16:33 user nova-compute[74963]:       <nova:root type="image" uuid="4f3508e6-5f58-445c-adc0-78fbfdaf19b9"/>
Nov 30 08:16:33 user nova-compute[74963]:       <nova:ports>
Nov 30 08:16:33 user nova-compute[74963]:         <nova:port uuid="ff3a0512-18ba-45c2-b1a4-7137ad1ac421">
Nov 30 08:16:33 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 08:16:33 user nova-compute[74963]:         </nova:port>
Nov 30 08:16:33 user nova-compute[74963]:       </nova:ports>
Nov 30 08:16:33 user nova-compute[74963]:     </nova:instance>
Nov 30 08:16:33 user nova-compute[74963]:   </metadata>
Nov 30 08:16:33 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:16:33 user nova-compute[74963]:     <system>
Nov 30 08:16:33 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:16:33 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:16:33 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:16:33 user nova-compute[74963]:       <entry name="serial">f4db2f97-c674-4da7-91d8-ed10cf4c964a</entry>
Nov 30 08:16:33 user nova-compute[74963]:       <entry name="uuid">f4db2f97-c674-4da7-91d8-ed10cf4c964a</entry>
Nov 30 08:16:33 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:16:33 user nova-compute[74963]:     </system>
Nov 30 08:16:33 user nova-compute[74963]:   </sysinfo>
Nov 30 08:16:33 user nova-compute[74963]:   <os>
Nov 30 08:16:33 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:16:33 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:16:33 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:16:33 user nova-compute[74963]:   </os>
Nov 30 08:16:33 user nova-compute[74963]:   <features>
Nov 30 08:16:33 user nova-compute[74963]:     <acpi/>
Nov 30 08:16:33 user nova-compute[74963]:     <apic/>
Nov 30 08:16:33 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:16:33 user nova-compute[74963]:   </features>
Nov 30 08:16:33 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:16:33 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:16:33 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:16:33 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:16:33 user nova-compute[74963]:   </clock>
Nov 30 08:16:33 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:16:33 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:16:33 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:16:33 user nova-compute[74963]:   </cpu>
Nov 30 08:16:33 user nova-compute[74963]:   <devices>
Nov 30 08:16:33 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:16:33 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:16:33 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk"/>
Nov 30 08:16:33 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:16:33 user nova-compute[74963]:     </disk>
Nov 30 08:16:33 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:16:33 user nova-compute[74963]:       <mac address="fa:16:3e:92:be:4d"/>
Nov 30 08:16:33 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:16:33 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:16:33 user nova-compute[74963]:       <target dev="tapff3a0512-18"/>
Nov 30 08:16:33 user nova-compute[74963]:     </interface>
Nov 30 08:16:33 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:16:33 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/console.log" append="off"/>
Nov 30 08:16:33 user nova-compute[74963]:     </serial>
Nov 30 08:16:33 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:16:33 user nova-compute[74963]:     <video>
Nov 30 08:16:33 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:16:33 user nova-compute[74963]:     </video>
Nov 30 08:16:33 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:16:33 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:16:33 user nova-compute[74963]:     </rng>
Nov 30 08:16:33 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:16:33 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:16:33 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:16:33 user nova-compute[74963]:     </memballoon>
Nov 30 08:16:33 user nova-compute[74963]:   </devices>
Nov 30 08:16:33 user nova-compute[74963]: </domain>
Nov 30 08:16:33 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1658909138',display_name='tempest-TestStampPattern-server-1658909138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1658909138',id=24,image_ref='4f3508e6-5f58-445c-adc0-78fbfdaf19b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXIfFHcf5hZJI1eOXWVSrzGJVOsClL3sRsQglOYWvzxqFcx/NwLGZqv1l34N2xD8aFbH1Lm1nfJS/HKaYuBZq5gxNl5qlH94PvOr+veB7phGIVgZOlhO4hSirM+QIZFUw==',key_name='tempest-TestStampPattern-1283092476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fa068a8025245e0aa581bfad0b5c324',ramdisk_id='',reservation_id='r-4xvjtsma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fd313577-5b50-48f3-b224-68542b958d21',image_min_disk='1',image_min_ram='0',image_owner_id='9fa068a8025245e0aa581bfad0b5c324',image_owner_project_name='tempest-TestStampPattern-14898091',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-14898091-project-member',image_user_id='a0406077bdf143258a2d84290bb449da',network_allocated='True',owner_project_name='tempest-TestStampPattern-14898091',owner_user_name='tempest-TestStampPattern-14898091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:16:30Z,user_data=None,user_id='a0406077bdf143258a2d84290bb449da',uuid=f4db2f97-c674-4da7-91d8-ed10cf4c964a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converting VIF {"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:be:4d,bridge_name='br-int',has_traffic_filtering=True,id=ff3a0512-18ba-45c2-b1a4-7137ad1ac421,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3a0512-18') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG os_vif [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:be:4d,bridge_name='br-int',has_traffic_filtering=True,id=ff3a0512-18ba-45c2-b1a4-7137ad1ac421,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3a0512-18') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06da4d6b-4f6b-5bb9-89ae-c85f1bdf3e02', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff3a0512-18, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff3a0512-18, col_values=(('qos', UUID('30479f12-a063-4e92-a1d2-c83bcac249cb')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff3a0512-18, col_values=(('external_ids', {'iface-id': 'ff3a0512-18ba-45c2-b1a4-7137ad1ac421', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:be:4d', 'vm-uuid': 'f4db2f97-c674-4da7-91d8-ed10cf4c964a'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:33 user nova-compute[74963]: INFO os_vif [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:be:4d,bridge_name='br-int',has_traffic_filtering=True,id=ff3a0512-18ba-45c2-b1a4-7137ad1ac421,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3a0512-18')
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No VIF found with MAC fa:16:3e:92:be:4d, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.network.neutron [req-83a9aa5e-d166-41d9-acbe-127a96bd7e4d req-e966df18-b95e-4b2f-ac7f-4bc78bf5c954 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Updated VIF entry in instance network info cache for port ff3a0512-18ba-45c2-b1a4-7137ad1ac421. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.network.neutron [req-83a9aa5e-d166-41d9-acbe-127a96bd7e4d req-e966df18-b95e-4b2f-ac7f-4bc78bf5c954 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Updating instance_info_cache with network_info: [{"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-83a9aa5e-d166-41d9-acbe-127a96bd7e4d req-e966df18-b95e-4b2f-ac7f-4bc78bf5c954 service nova] Releasing lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:16:33 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 08:16:33 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplwdt6ulh/360ba52e37b74dc78240afd5549bc6d3.delta /opt/stack/data/nova/instances/snapshots/tmplwdt6ulh/360ba52e37b74dc78240afd5549bc6d3 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplwdt6ulh/360ba52e37b74dc78240afd5549bc6d3.delta /opt/stack/data/nova/instances/snapshots/tmplwdt6ulh/360ba52e37b74dc78240afd5549bc6d3" returned: 0 in 0.450s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:34 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Snapshot extracted, beginning image upload
Nov 30 08:16:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG nova.compute.manager [req-7680743d-088b-465c-b14a-cbb594dde6f8 req-479843f0-fa35-49cb-87dc-019feee6c952 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received event network-vif-plugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7680743d-088b-465c-b14a-cbb594dde6f8 req-479843f0-fa35-49cb-87dc-019feee6c952 service nova] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7680743d-088b-465c-b14a-cbb594dde6f8 req-479843f0-fa35-49cb-87dc-019feee6c952 service nova] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7680743d-088b-465c-b14a-cbb594dde6f8 req-479843f0-fa35-49cb-87dc-019feee6c952 service nova] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:34 user nova-compute[74963]: DEBUG nova.compute.manager [req-7680743d-088b-465c-b14a-cbb594dde6f8 req-479843f0-fa35-49cb-87dc-019feee6c952 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] No waiting events found dispatching network-vif-plugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:16:34 user nova-compute[74963]: WARNING nova.compute.manager [req-7680743d-088b-465c-b14a-cbb594dde6f8 req-479843f0-fa35-49cb-87dc-019feee6c952 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received unexpected event network-vif-plugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 for instance with vm_state building and task_state spawning.
Nov 30 08:16:36 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Snapshot image upload complete
Nov 30 08:16:36 user nova-compute[74963]: INFO nova.compute.manager [None req-8a576bc3-afc4-4167-8650-d306c1dd427a tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Took 6.82 seconds to snapshot the instance on the hypervisor.
Nov 30 08:16:36 user nova-compute[74963]: DEBUG nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:16:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:16:36 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Instance spawned successfully.
Nov 30 08:16:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:16:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:16:36 user nova-compute[74963]: INFO nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Took 6.67 seconds to spawn the instance on the hypervisor.
Nov 30 08:16:36 user nova-compute[74963]: DEBUG nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:16:36 user nova-compute[74963]: DEBUG nova.compute.manager [req-f61c2940-6947-44b0-9b1b-df767f8c110a req-a327433a-8277-43fb-8918-bea8422b8a25 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received event network-vif-plugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f61c2940-6947-44b0-9b1b-df767f8c110a req-a327433a-8277-43fb-8918-bea8422b8a25 service nova] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f61c2940-6947-44b0-9b1b-df767f8c110a req-a327433a-8277-43fb-8918-bea8422b8a25 service nova] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f61c2940-6947-44b0-9b1b-df767f8c110a req-a327433a-8277-43fb-8918-bea8422b8a25 service nova] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:36 user nova-compute[74963]: DEBUG nova.compute.manager [req-f61c2940-6947-44b0-9b1b-df767f8c110a req-a327433a-8277-43fb-8918-bea8422b8a25 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] No waiting events found dispatching network-vif-plugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:16:36 user nova-compute[74963]: WARNING nova.compute.manager [req-f61c2940-6947-44b0-9b1b-df767f8c110a req-a327433a-8277-43fb-8918-bea8422b8a25 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received unexpected event network-vif-plugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 for instance with vm_state building and task_state spawning.
Nov 30 08:16:36 user nova-compute[74963]: INFO nova.compute.manager [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Took 7.64 seconds to build instance.
Nov 30 08:16:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-476fdcc3-5522-45c8-94a2-4f70d5d61899 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.739s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:37 user nova-compute[74963]: INFO nova.compute.manager [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Terminating instance
Nov 30 08:16:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-054d8e19-9c43-46d3-869e-6805caea63e8 req-37748fe9-c50f-45a0-b850-ac6e4be56a92 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received event network-vif-unplugged-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-054d8e19-9c43-46d3-869e-6805caea63e8 req-37748fe9-c50f-45a0-b850-ac6e4be56a92 service nova] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-054d8e19-9c43-46d3-869e-6805caea63e8 req-37748fe9-c50f-45a0-b850-ac6e4be56a92 service nova] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-054d8e19-9c43-46d3-869e-6805caea63e8 req-37748fe9-c50f-45a0-b850-ac6e4be56a92 service nova] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-054d8e19-9c43-46d3-869e-6805caea63e8 req-37748fe9-c50f-45a0-b850-ac6e4be56a92 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] No waiting events found dispatching network-vif-unplugged-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-054d8e19-9c43-46d3-869e-6805caea63e8 req-37748fe9-c50f-45a0-b850-ac6e4be56a92 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received event network-vif-unplugged-6644ce62-9413-492a-9550-0969a30b8e50 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:16:38 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Instance destroyed successfully.
Nov 30 08:16:38 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lazy-loading 'resources' on Instance uuid bb855029-8201-4c59-a4d2-3fac4a14fec9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-902447542',display_name='tempest-VolumesAdminNegativeTest-server-902447542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-902447542',id=14,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCUA2w3dykG0qemP6SHe5PR2KxuUnpCOZvjUzicHWyg0U7qEuUH7EnbWVEfXUOvEHNjBBK7IgFBh2Ciy/FO3J3qtuAuHGfKKlxqUj7C354uviEh5RWey/h5PQcUMwtd1A==',key_name='tempest-keypair-1495260622',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a587ec45f21498ea140a9989398052e',ramdisk_id='',reservation_id='r-dd04i4n8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1226639972',owner_user_name='tempest-VolumesAdminNegativeTest-1226639972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85ae318785fd41ec87f9598fd18c593a',uuid=bb855029-8201-4c59-a4d2-3fac4a14fec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converting VIF {"id": "6644ce62-9413-492a-9550-0969a30b8e50", "address": "fa:16:3e:46:bc:97", "network": {"id": "31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2010400313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a587ec45f21498ea140a9989398052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6644ce62-94", "ovs_interfaceid": "6644ce62-9413-492a-9550-0969a30b8e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:bc:97,bridge_name='br-int',has_traffic_filtering=True,id=6644ce62-9413-492a-9550-0969a30b8e50,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6644ce62-94') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG os_vif [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:bc:97,bridge_name='br-int',has_traffic_filtering=True,id=6644ce62-9413-492a-9550-0969a30b8e50,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6644ce62-94') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6644ce62-94, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1980b0c1-eb2d-4586-83a7-c5d05e8818e0) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:38 user nova-compute[74963]: INFO os_vif [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:bc:97,bridge_name='br-int',has_traffic_filtering=True,id=6644ce62-9413-492a-9550-0969a30b8e50,network=Network(31b6a34f-6b43-4f3f-9594-a9ac3b4ffc7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6644ce62-94')
Nov 30 08:16:38 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Deleting instance files /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9_del
Nov 30 08:16:38 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Deletion of /opt/stack/data/nova/instances/bb855029-8201-4c59-a4d2-3fac4a14fec9_del complete
Nov 30 08:16:38 user nova-compute[74963]: INFO nova.compute.manager [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 30 08:16:38 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:16:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:16:40 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Took 1.42 seconds to deallocate network for instance.
Nov 30 08:16:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-afe1688b-8898-4426-80de-058be9136e20 req-7f5a536f-fdf5-42a6-8842-ac76f8d71d12 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received event network-vif-deleted-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-b122eab7-fed2-4b7a-8f2e-a287438d7aa3 req-21883b64-1981-48f8-a507-253cdd1a5791 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received event network-vif-plugged-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b122eab7-fed2-4b7a-8f2e-a287438d7aa3 req-21883b64-1981-48f8-a507-253cdd1a5791 service nova] Acquiring lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b122eab7-fed2-4b7a-8f2e-a287438d7aa3 req-21883b64-1981-48f8-a507-253cdd1a5791 service nova] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b122eab7-fed2-4b7a-8f2e-a287438d7aa3 req-21883b64-1981-48f8-a507-253cdd1a5791 service nova] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-b122eab7-fed2-4b7a-8f2e-a287438d7aa3 req-21883b64-1981-48f8-a507-253cdd1a5791 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] No waiting events found dispatching network-vif-plugged-6644ce62-9413-492a-9550-0969a30b8e50 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:16:40 user nova-compute[74963]: WARNING nova.compute.manager [req-b122eab7-fed2-4b7a-8f2e-a287438d7aa3 req-21883b64-1981-48f8-a507-253cdd1a5791 service nova] [instance: bb855029-8201-4c59-a4d2-3fac4a14fec9] Received unexpected event network-vif-plugged-6644ce62-9413-492a-9550-0969a30b8e50 for instance with vm_state active and task_state deleting.
Nov 30 08:16:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:16:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:40 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Deleted allocations for instance bb855029-8201-4c59-a4d2-3fac4a14fec9
Nov 30 08:16:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ded798d6-d006-4795-b1d6-78be8a741766 tempest-VolumesAdminNegativeTest-1226639972 tempest-VolumesAdminNegativeTest-1226639972-project-member] Lock "bb855029-8201-4c59-a4d2-3fac4a14fec9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.035s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-59efd066-e945-43f7-bf69-1c6a5e587b2c req-38a9d4dd-5f85-457b-89f3-74bf3219edb2 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-changed-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:16:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-59efd066-e945-43f7-bf69-1c6a5e587b2c req-38a9d4dd-5f85-457b-89f3-74bf3219edb2 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Refreshing instance network info cache due to event network-changed-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:16:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-59efd066-e945-43f7-bf69-1c6a5e587b2c req-38a9d4dd-5f85-457b-89f3-74bf3219edb2 service nova] Acquiring lock "refresh_cache-7c420b98-c113-4ce1-94e8-31e9e9525f67" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:16:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-59efd066-e945-43f7-bf69-1c6a5e587b2c req-38a9d4dd-5f85-457b-89f3-74bf3219edb2 service nova] Acquired lock "refresh_cache-7c420b98-c113-4ce1-94e8-31e9e9525f67" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG nova.network.neutron [req-59efd066-e945-43f7-bf69-1c6a5e587b2c req-38a9d4dd-5f85-457b-89f3-74bf3219edb2 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Refreshing network info cache for port 3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG nova.network.neutron [req-59efd066-e945-43f7-bf69-1c6a5e587b2c req-38a9d4dd-5f85-457b-89f3-74bf3219edb2 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Updated VIF entry in instance network info cache for port 3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG nova.network.neutron [req-59efd066-e945-43f7-bf69-1c6a5e587b2c req-38a9d4dd-5f85-457b-89f3-74bf3219edb2 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Updating instance_info_cache with network_info: [{"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-59efd066-e945-43f7-bf69-1c6a5e587b2c req-38a9d4dd-5f85-457b-89f3-74bf3219edb2 service nova] Releasing lock "refresh_cache-7c420b98-c113-4ce1-94e8-31e9e9525f67" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG nova.objects.instance [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'flavor' on Instance uuid 7c420b98-c113-4ce1-94e8-31e9e9525f67 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:16:50 user nova-compute[74963]: INFO nova.compute.manager [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Attaching volume 53b76d17-133b-4587-b9b0-8dc8ea688bff to /dev/vdb
Nov 30 08:16:50 user nova-compute[74963]: DEBUG os_brick.utils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6730cf56-813a-469e-b0b8-95a923afbefa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a462cafc-eb31-432d-bee2-fcb84bf2bcec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9f9b4-ff50-4fb9-9192-e75e52933fdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[498c332e-9b52-4dac-b5dd-7dc9890f0ac5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:16:50 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:16:50 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a204d6-336d-4682-9237-8ced42ffc27b]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG os_brick.utils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:16:50 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Updating existing volume attachment record: c1ec7292-2532-4040-a15d-5abe6180751b {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:16:53 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:16:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhjzBSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:16:59 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:16:59 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:16:59 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a4dd97-1d7c-439b-a8f8-29574b40e008]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:16:59 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e495fd8d-b38d-419c-b081-de2ffb642169]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff] added
Nov 30 08:16:59 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab942f-a951-49d8-aabd-f441eab2c8c7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9899a43e-d037-4d9e-9ecd-3aad6fd1cccc]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVhjzBSg {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVhjzBSg" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce8321e-c0ca-4048-b858-7c1534b398ca]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oVhjzBSg'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc333e5-b33a-40a9-bed4-c46614805317]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a244bdb-d790-460c-ae7f-40c930e53a5e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:16:59 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:16:59 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[da89ceac-94c4-4c2b-b4fe-4fdb2382c14c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260]
Nov 30 08:16:59 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260] successful.
Nov 30 08:16:59 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2777e51b-7a5d-42c9-a29a-aecc407f3fa2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e340d412-28f2-48cc-bc54-a8434a0f0521]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:16:59 user nova-compute[74963]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:16:59 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:16:59 user nova-compute[74963]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:16:59 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a791692-42f6-406b-bf68-998bb3a06fa0]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:16:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhjzBSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74963) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26235376266623237', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235376266623237', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'flavor' on Instance uuid 7c420b98-c113-4ce1-94e8-31e9e9525f67 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:17:00 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:17:00 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:17:00 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:17:00 user nova-compute[74963]:   <serial>53b76d17-133b-4587-b9b0-8dc8ea688bff</serial>
Nov 30 08:17:00 user nova-compute[74963]: </disk>
Nov 30 08:17:00 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No VIF found with MAC fa:16:3e:b8:44:e8, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:17:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-4b3b3d2f-fddb-4c76-a2ce-1005e7334e8d tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.205s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:02 user nova-compute[74963]: INFO nova.compute.manager [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Rebuilding instance
Nov 30 08:17:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:17:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-fbe20b21-5328-4691-88a8-831dbe984949 req-11b8de62-659b-4430-a1d1-13f2b2fca6e7 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-unplugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fbe20b21-5328-4691-88a8-831dbe984949 req-11b8de62-659b-4430-a1d1-13f2b2fca6e7 service nova] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fbe20b21-5328-4691-88a8-831dbe984949 req-11b8de62-659b-4430-a1d1-13f2b2fca6e7 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fbe20b21-5328-4691-88a8-831dbe984949 req-11b8de62-659b-4430-a1d1-13f2b2fca6e7 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-fbe20b21-5328-4691-88a8-831dbe984949 req-11b8de62-659b-4430-a1d1-13f2b2fca6e7 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] No waiting events found dispatching network-vif-unplugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:17:02 user nova-compute[74963]: WARNING nova.compute.manager [req-fbe20b21-5328-4691-88a8-831dbe984949 req-11b8de62-659b-4430-a1d1-13f2b2fca6e7 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received unexpected event network-vif-unplugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 for instance with vm_state active and task_state rebuilding.
Nov 30 08:17:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:17:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Instance destroyed successfully.
Nov 30 08:17:03 user nova-compute[74963]: INFO nova.compute.manager [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Detaching volume 53b76d17-133b-4587-b9b0-8dc8ea688bff
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: INFO nova.virt.block_device [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Attempting to driver detach volume 53b76d17-133b-4587-b9b0-8dc8ea688bff from mountpoint /dev/vdb
Nov 30 08:17:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Attempting to detach device vdb from instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:17:03 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:17:03 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:17:03 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:17:03 user nova-compute[74963]:   <serial>53b76d17-133b-4587-b9b0-8dc8ea688bff</serial>
Nov 30 08:17:03 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:17:03 user nova-compute[74963]: </disk>
Nov 30 08:17:03 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:17:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully detached device vdb from instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 from the persistent domain config.
Nov 30 08:17:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhjzBSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:17:03 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3858a1c1-3f02-4e4c-9fbe-458fab50e305]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:17:03 user nova-compute[74963]: No targets found.
Nov 30 08:17:03 user nova-compute[74963]: iSNS:
Nov 30 08:17:03 user nova-compute[74963]: No targets found.
Nov 30 08:17:03 user nova-compute[74963]: STATIC:
Nov 30 08:17:03 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff
Nov 30 08:17:03 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:17:03 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:17:03 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:17:03 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:17:03 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:17:03 user nova-compute[74963]: FIRMWARE:
Nov 30 08:17:03 user nova-compute[74963]: No targets found.
Nov 30 08:17:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:17:03 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:17:03 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe746d8-7ffa-4300-b2cf-6472d73e9419]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7014d26c-ec84-4a59-a0b7-ef53de29e801]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:03 user nova-compute[74963]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:17:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:03 user nova-compute[74963]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:17:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244388790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf776a01-e148-4b8b-a342-59200fc770da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e145ceb-10b1-4efa-8cfe-62411cbfd130]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3353e8e-837e-4f73-8453-adab2b02b3ff]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e485aa-8242-49ed-8e75-cf1661487952]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[01648beb-9c65-4af9-b727-8853ae97d14f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[806a7f40-729c-48d9-be4a-899d632759b2]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260]
Nov 30 08:17:03 user nova-compute[74963]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260] successful.
Nov 30 08:17:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b1a5b9-5fc9-4492-90ac-1335f800e0d0]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== disconnect_volume: return (343ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-2fd3dfae-b874-4135-ac6b-46bd22f793a2 req-6c869cf4-2402-4b48-ba7d-a385bf3fda7d service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2fd3dfae-b874-4135-ac6b-46bd22f793a2 req-6c869cf4-2402-4b48-ba7d-a385bf3fda7d service nova] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2fd3dfae-b874-4135-ac6b-46bd22f793a2 req-6c869cf4-2402-4b48-ba7d-a385bf3fda7d service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2fd3dfae-b874-4135-ac6b-46bd22f793a2 req-6c869cf4-2402-4b48-ba7d-a385bf3fda7d service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-2fd3dfae-b874-4135-ac6b-46bd22f793a2 req-6c869cf4-2402-4b48-ba7d-a385bf3fda7d service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] No waiting events found dispatching network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:17:04 user nova-compute[74963]: WARNING nova.compute.manager [req-2fd3dfae-b874-4135-ac6b-46bd22f793a2 req-6c869cf4-2402-4b48-ba7d-a385bf3fda7d service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received unexpected event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 for instance with vm_state active and task_state rebuilding.
Nov 30 08:17:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Instance destroyed successfully.
Nov 30 08:17:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-717755624',display_name='tempest-ServerActionsTestOtherA-server-742201224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-717755624',id=21,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGhTzyuOSLvbt34DavgeYG1BIdcE+3bBbpAiBsIdXmjz1e75zxd6ooC/FD4AaX8M1mz3vKXEWbpVF0g6gA9lKzklv7j1uEVOsgCpOxYQS4sQ7noSFAhgsTV6eQwf1hyPA==',key_name='tempest-keypair-513063568',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-miqeomp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=7c420b98-c113-4ce1-94e8-31e9e9525f67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_vif [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cae6733-e7, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efc788a9-1f5e-43b8-8ab4-a99d13cbc89d) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:17:04 user nova-compute[74963]: INFO os_vif [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7')
Nov 30 08:17:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhjzBSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:17:04 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e401efe-b8ed-412c-bbe0-f3c439421fcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:17:04 user nova-compute[74963]: No targets found.
Nov 30 08:17:04 user nova-compute[74963]: iSNS:
Nov 30 08:17:04 user nova-compute[74963]: No targets found.
Nov 30 08:17:04 user nova-compute[74963]: STATIC:
Nov 30 08:17:04 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:17:04 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:17:04 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:17:04 user nova-compute[74963]: FIRMWARE:
Nov 30 08:17:04 user nova-compute[74963]: No targets found.
Nov 30 08:17:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:17:04 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:17:04 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc4978e-e822-4d30-8a7c-b6b513470ca5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[877ddd34-6afc-4d90-88d0-8d0646f33d13]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62441f4670>, {}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Disconnecting from: [] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== disconnect_volume: return (99ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:17:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:17:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Deleting instance files /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67_del
Nov 30 08:17:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Deletion of /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67_del complete
Nov 30 08:17:05 user nova-compute[74963]: INFO nova.virt.block_device [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Booting with volume 53b76d17-133b-4587-b9b0-8dc8ea688bff at /dev/vdb
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG os_brick.utils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[54aab141-3ae7-406d-94ee-48a90c452a86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[671c985c-884d-467e-8904-726844783a19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69e8545-99a2-4fc0-ae2c-c430c9f5c76d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a17c0f-5238-4f04-912e-5209bbe7901b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:17:05 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a9aa77-2a60-42b4-809f-2c96fdb07607]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG os_brick.utils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Updating existing volume attachment record: cc8608de-086a-44cf-ad2f-127b408480eb {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:17:05 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid '7c420b98-c113-4ce1-94e8-31e9e9525f67' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid '7c420b98-c113-4ce1-94e8-31e9e9525f67' (instance-00000015)
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:07 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:17:07 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:17:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7650MB free_disk=25.107078552246094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:17:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance fd313577-5b50-48f3-b224-68542b958d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1528211a-3b92-46aa-8512-5c2568f361ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance f4db2f97-c674-4da7-91d8-ed10cf4c964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing inventories for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating ProviderTree inventory for provider 41961ac9-576a-4a02-a5e7-459f54657b3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating inventory in ProviderTree for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing aggregate associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, aggregates: None {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing trait associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:09 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:09 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:09 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:17:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:17:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:17:09 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:17:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:10 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updating instance_info_cache with network_info: [{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:17:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:17:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:17:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:17:13 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Creating image(s)
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk 1073741824" returned: 0 in 0.046s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] There are 0 instances to clean {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Cannot resize image /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Ensure instance console log exists: /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Start _get_guest_xml network_info=[{"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhjzBSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c420b98-c113-4ce1-94e8-31e9e9525f67', 'attached_at': '', 'detached_at': '', 'volume_id': '53b76d17-133b-4587-b9b0-8dc8ea688bff', 'serial': '53b76d17-133b-4587-b9b0-8dc8ea688bff'}, 'attachment_id': 'cc8608de-086a-44cf-ad2f-127b408480eb', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:17:14 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 08:17:14 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c420b98-c113-4ce1-94e8-31e9e9525f67 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhjzBSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:17:14 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:17:14 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:17:14 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4abae-5230-424c-8e81-93a2a0ff60d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:17:14 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[33296e35-b5af-4af2-a965-7e9031bb3cfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff] added
Nov 30 08:17:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fb62a9-2eee-4614-9583-66477978fd18]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c994b6e-bc50-4d3e-baf8-c650fc90bf7d]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVhjzBSg {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVhjzBSg" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc345f65-2cdc-4cea-9145-701ba3c159f6]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oVhjzBSg'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[866e31bc-ed8b-4943-b4b9-cdbaecf293b1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560fd08-291f-4682-83b3-5ab5101224b6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de151197-0cb1-4681-8d65-fe98690683f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260]
Nov 30 08:17:14 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260] successful.
Nov 30 08:17:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4574b168-733e-48d7-961d-e916c6a3bd71]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f21dca6-a309-4e08-8978-e46157f2e36a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:14 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:17:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:14 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:17:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4129e8e-ee8e-4da6-b3bf-589b663c5be0]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:17:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhjzBSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26235376266623237', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235376266623237', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T08:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-717755624',display_name='tempest-ServerActionsTestOtherA-server-742201224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-717755624',id=21,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGhTzyuOSLvbt34DavgeYG1BIdcE+3bBbpAiBsIdXmjz1e75zxd6ooC/FD4AaX8M1mz3vKXEWbpVF0g6gA9lKzklv7j1uEVOsgCpOxYQS4sQ7noSFAhgsTV6eQwf1hyPA==',key_name='tempest-keypair-513063568',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-miqeomp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=7c420b98-c113-4ce1-94e8-31e9e9525f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:17:15 user nova-compute[74963]:   <uuid>7c420b98-c113-4ce1-94e8-31e9e9525f67</uuid>
Nov 30 08:17:15 user nova-compute[74963]:   <name>instance-00000015</name>
Nov 30 08:17:15 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:17:15 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:17:15 user nova-compute[74963]:   <metadata>
Nov 30 08:17:15 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:17:15 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:17:15 user nova-compute[74963]:       <nova:name>tempest-ServerActionsTestOtherA-server-742201224</nova:name>
Nov 30 08:17:15 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:17:14</nova:creationTime>
Nov 30 08:17:15 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:17:15 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:17:15 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:17:15 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:17:15 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:17:15 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:17:15 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:17:15 user nova-compute[74963]:       <nova:owner>
Nov 30 08:17:15 user nova-compute[74963]:         <nova:user uuid="c803479aa87e4be79682975d47b7ccfd">tempest-ServerActionsTestOtherA-768867057-project-member</nova:user>
Nov 30 08:17:15 user nova-compute[74963]:         <nova:project uuid="e22db86fd7a54c5c9882623605de5608">tempest-ServerActionsTestOtherA-768867057</nova:project>
Nov 30 08:17:15 user nova-compute[74963]:       </nova:owner>
Nov 30 08:17:15 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:17:15 user nova-compute[74963]:       <nova:ports>
Nov 30 08:17:15 user nova-compute[74963]:         <nova:port uuid="3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1">
Nov 30 08:17:15 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 08:17:15 user nova-compute[74963]:         </nova:port>
Nov 30 08:17:15 user nova-compute[74963]:       </nova:ports>
Nov 30 08:17:15 user nova-compute[74963]:     </nova:instance>
Nov 30 08:17:15 user nova-compute[74963]:   </metadata>
Nov 30 08:17:15 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:17:15 user nova-compute[74963]:     <system>
Nov 30 08:17:15 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:17:15 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:17:15 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:17:15 user nova-compute[74963]:       <entry name="serial">7c420b98-c113-4ce1-94e8-31e9e9525f67</entry>
Nov 30 08:17:15 user nova-compute[74963]:       <entry name="uuid">7c420b98-c113-4ce1-94e8-31e9e9525f67</entry>
Nov 30 08:17:15 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:17:15 user nova-compute[74963]:     </system>
Nov 30 08:17:15 user nova-compute[74963]:   </sysinfo>
Nov 30 08:17:15 user nova-compute[74963]:   <os>
Nov 30 08:17:15 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:17:15 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:17:15 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:17:15 user nova-compute[74963]:   </os>
Nov 30 08:17:15 user nova-compute[74963]:   <features>
Nov 30 08:17:15 user nova-compute[74963]:     <acpi/>
Nov 30 08:17:15 user nova-compute[74963]:     <apic/>
Nov 30 08:17:15 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:17:15 user nova-compute[74963]:   </features>
Nov 30 08:17:15 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:17:15 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:17:15 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:17:15 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:17:15 user nova-compute[74963]:   </clock>
Nov 30 08:17:15 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:17:15 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:17:15 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:17:15 user nova-compute[74963]:   </cpu>
Nov 30 08:17:15 user nova-compute[74963]:   <devices>
Nov 30 08:17:15 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:17:15 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:17:15 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk"/>
Nov 30 08:17:15 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:17:15 user nova-compute[74963]:     </disk>
Nov 30 08:17:15 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:17:15 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:17:15 user nova-compute[74963]:       <source dev="/dev/sdb"/>
Nov 30 08:17:15 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:17:15 user nova-compute[74963]:       <serial>53b76d17-133b-4587-b9b0-8dc8ea688bff</serial>
Nov 30 08:17:15 user nova-compute[74963]:     </disk>
Nov 30 08:17:15 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:17:15 user nova-compute[74963]:       <mac address="fa:16:3e:b8:44:e8"/>
Nov 30 08:17:15 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:17:15 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:17:15 user nova-compute[74963]:       <target dev="tap3cae6733-e7"/>
Nov 30 08:17:15 user nova-compute[74963]:     </interface>
Nov 30 08:17:15 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:17:15 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/console.log" append="off"/>
Nov 30 08:17:15 user nova-compute[74963]:     </serial>
Nov 30 08:17:15 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:17:15 user nova-compute[74963]:     <video>
Nov 30 08:17:15 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:17:15 user nova-compute[74963]:     </video>
Nov 30 08:17:15 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:17:15 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:17:15 user nova-compute[74963]:     </rng>
Nov 30 08:17:15 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:17:15 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:17:15 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:17:15 user nova-compute[74963]:     </memballoon>
Nov 30 08:17:15 user nova-compute[74963]:   </devices>
Nov 30 08:17:15 user nova-compute[74963]: </domain>
Nov 30 08:17:15 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T08:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-717755624',display_name='tempest-ServerActionsTestOtherA-server-742201224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-717755624',id=21,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGhTzyuOSLvbt34DavgeYG1BIdcE+3bBbpAiBsIdXmjz1e75zxd6ooC/FD4AaX8M1mz3vKXEWbpVF0g6gA9lKzklv7j1uEVOsgCpOxYQS4sQ7noSFAhgsTV6eQwf1hyPA==',key_name='tempest-keypair-513063568',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-miqeomp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=7c420b98-c113-4ce1-94e8-31e9e9525f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG os_vif [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed14fa4e-bf3a-5555-8f4b-0b04e5895eb5', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cae6733-e7, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cae6733-e7, col_values=(('qos', UUID('f9f24270-f76b-4001-b690-683d7341c184')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cae6733-e7, col_values=(('external_ids', {'iface-id': '3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:44:e8', 'vm-uuid': '7c420b98-c113-4ce1-94e8-31e9e9525f67'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:15 user nova-compute[74963]: INFO os_vif [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7')
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:17:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No VIF found with MAC fa:16:3e:b8:44:e8, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:17:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-95adb36e-9ad5-4e2d-993f-5d50eabb0f38 req-c935e81f-cde8-4740-b742-1b92b39558d8 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-95adb36e-9ad5-4e2d-993f-5d50eabb0f38 req-c935e81f-cde8-4740-b742-1b92b39558d8 service nova] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-95adb36e-9ad5-4e2d-993f-5d50eabb0f38 req-c935e81f-cde8-4740-b742-1b92b39558d8 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-95adb36e-9ad5-4e2d-993f-5d50eabb0f38 req-c935e81f-cde8-4740-b742-1b92b39558d8 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-95adb36e-9ad5-4e2d-993f-5d50eabb0f38 req-c935e81f-cde8-4740-b742-1b92b39558d8 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] No waiting events found dispatching network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:17:17 user nova-compute[74963]: WARNING nova.compute.manager [req-95adb36e-9ad5-4e2d-993f-5d50eabb0f38 req-c935e81f-cde8-4740-b742-1b92b39558d8 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received unexpected event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 08:17:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:17:19 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Instance spawned successfully.
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74963) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-b634fd86-39ac-4b39-b927-8dd5341e2075 req-571a5828-3a74-4696-b665-fab99422b6a9 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b634fd86-39ac-4b39-b927-8dd5341e2075 req-571a5828-3a74-4696-b665-fab99422b6a9 service nova] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b634fd86-39ac-4b39-b927-8dd5341e2075 req-571a5828-3a74-4696-b665-fab99422b6a9 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b634fd86-39ac-4b39-b927-8dd5341e2075 req-571a5828-3a74-4696-b665-fab99422b6a9 service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-b634fd86-39ac-4b39-b927-8dd5341e2075 req-571a5828-3a74-4696-b665-fab99422b6a9 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] No waiting events found dispatching network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:17:19 user nova-compute[74963]: WARNING nova.compute.manager [req-b634fd86-39ac-4b39-b927-8dd5341e2075 req-571a5828-3a74-4696-b665-fab99422b6a9 service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received unexpected event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 for instance with vm_state active and task_state None.
Nov 30 08:17:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e697cae9-9675-4907-9fd4-c2df772c7b4e tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:37 user nova-compute[74963]: INFO nova.compute.manager [None req-114ecbe5-7b11-4368-85a0-11704f4de978 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Unrescuing
Nov 30 08:17:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-114ecbe5-7b11-4368-85a0-11704f4de978 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:17:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-114ecbe5-7b11-4368-85a0-11704f4de978 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquired lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:17:37 user nova-compute[74963]: DEBUG nova.network.neutron [None req-114ecbe5-7b11-4368-85a0-11704f4de978 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:17:38 user nova-compute[74963]: DEBUG nova.network.neutron [None req-114ecbe5-7b11-4368-85a0-11704f4de978 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updating instance_info_cache with network_info: [{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:17:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-114ecbe5-7b11-4368-85a0-11704f4de978 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Releasing lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:17:38 user nova-compute[74963]: DEBUG nova.objects.instance [None req-114ecbe5-7b11-4368-85a0-11704f4de978 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'flavor' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:17:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:17:39 user nova-compute[74963]: INFO nova.compute.claims [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Claim successful on node user
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.compute.manager [req-ac57c342-4f85-4eb0-b434-a46a8b3c0b03 req-f4a5be06-31b5-4776-bf14-93becf0683e9 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ac57c342-4f85-4eb0-b434-a46a8b3c0b03 req-f4a5be06-31b5-4776-bf14-93becf0683e9 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ac57c342-4f85-4eb0-b434-a46a8b3c0b03 req-f4a5be06-31b5-4776-bf14-93becf0683e9 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ac57c342-4f85-4eb0-b434-a46a8b3c0b03 req-f4a5be06-31b5-4776-bf14-93becf0683e9 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.compute.manager [req-ac57c342-4f85-4eb0-b434-a46a8b3c0b03 req-f4a5be06-31b5-4776-bf14-93becf0683e9 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:17:39 user nova-compute[74963]: WARNING nova.compute.manager [req-ac57c342-4f85-4eb0-b434-a46a8b3c0b03 req-f4a5be06-31b5-4776-bf14-93becf0683e9 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:17:39 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Instance destroyed successfully.
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:17:39 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:17:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:17:39 user nova-compute[74963]: INFO nova.virt.block_device [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Booting with volume-backed-image ea262e08-aaf0-444c-be1e-ba1d8691ac72 at /dev/vda
Nov 30 08:17:40 user nova-compute[74963]: DEBUG nova.policy [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b110fcb508342509690b45e1854eb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce233bd757b64de4bd6f6abb3230da01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:17:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-ac37469e-e9b8-4942-8738-55a05f2087e7 req-7f99daed-82d5-4325-8ebb-401d2a716b6a service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ac37469e-e9b8-4942-8738-55a05f2087e7 req-7f99daed-82d5-4325-8ebb-401d2a716b6a service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ac37469e-e9b8-4942-8738-55a05f2087e7 req-7f99daed-82d5-4325-8ebb-401d2a716b6a service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ac37469e-e9b8-4942-8738-55a05f2087e7 req-7f99daed-82d5-4325-8ebb-401d2a716b6a service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-ac37469e-e9b8-4942-8738-55a05f2087e7 req-7f99daed-82d5-4325-8ebb-401d2a716b6a service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:17:41 user nova-compute[74963]: WARNING nova.compute.manager [req-ac37469e-e9b8-4942-8738-55a05f2087e7 req-7f99daed-82d5-4325-8ebb-401d2a716b6a service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:17:41 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Successfully created port: 8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:17:42 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Successfully updated port: 8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:17:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:17:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquired lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:17:42 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:17:42 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-114ecbe5-7b11-4368-85a0-11704f4de978 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:17:43 user nova-compute[74963]: WARNING nova.compute.manager [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state None.
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:17:43 user nova-compute[74963]: WARNING nova.compute.manager [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state active and task_state None.
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-changed-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Refreshing instance network info cache due to event network-changed-8bd435ad-5e5a-45c7-8282-3819f0935b25. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] Acquiring lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.network.neutron [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Updating instance_info_cache with network_info: [{"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Releasing lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Instance network_info: |[{"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] Acquired lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG nova.network.neutron [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Refreshing network info cache for port 8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:17:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:44 user nova-compute[74963]: DEBUG nova.network.neutron [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Updated VIF entry in instance network info cache for port 8bd435ad-5e5a-45c7-8282-3819f0935b25. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:17:44 user nova-compute[74963]: DEBUG nova.network.neutron [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Updating instance_info_cache with network_info: [{"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:17:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcb6c5fe-00a6-4667-a82e-3738e05c42a1 req-2eec92ca-2a3b-4cf9-af15-b42977816a51 service nova] Releasing lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG os_brick.utils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8488a37-bb4a-45dc-b9ed-800dc91030f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7065cc4-c9c5-4120-a56f-b370eb1faa1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e66723-ff08-44e4-a61c-22d038ece317]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e75926-5e4b-4e6a-b080-e366051a1742]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:17:45 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:17:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[074858eb-d241-4a53-9cdd-c67748dcc719]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG os_brick.utils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:17:45 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Updating existing volume attachment record: 18ec926a-dada-4e9f-bf9a-195f63118f91 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:17:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-ef5d4c46-56b6-4310-8397-2bf6db2670ab req-ca29e488-59b3-4cc9-9d8d-f3696c5d5ef3 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-changed-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-ef5d4c46-56b6-4310-8397-2bf6db2670ab req-ca29e488-59b3-4cc9-9d8d-f3696c5d5ef3 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Refreshing instance network info cache due to event network-changed-af90eb0e-d1c3-4629-9d1a-1c224e637b11. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:17:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ef5d4c46-56b6-4310-8397-2bf6db2670ab req-ca29e488-59b3-4cc9-9d8d-f3696c5d5ef3 service nova] Acquiring lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:17:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ef5d4c46-56b6-4310-8397-2bf6db2670ab req-ca29e488-59b3-4cc9-9d8d-f3696c5d5ef3 service nova] Acquired lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:17:53 user nova-compute[74963]: DEBUG nova.network.neutron [req-ef5d4c46-56b6-4310-8397-2bf6db2670ab req-ca29e488-59b3-4cc9-9d8d-f3696c5d5ef3 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Refreshing network info cache for port af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:17:53 user nova-compute[74963]: DEBUG nova.network.neutron [req-ef5d4c46-56b6-4310-8397-2bf6db2670ab req-ca29e488-59b3-4cc9-9d8d-f3696c5d5ef3 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updated VIF entry in instance network info cache for port af90eb0e-d1c3-4629-9d1a-1c224e637b11. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:17:53 user nova-compute[74963]: DEBUG nova.network.neutron [req-ef5d4c46-56b6-4310-8397-2bf6db2670ab req-ca29e488-59b3-4cc9-9d8d-f3696c5d5ef3 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updating instance_info_cache with network_info: [{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:17:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ef5d4c46-56b6-4310-8397-2bf6db2670ab req-ca29e488-59b3-4cc9-9d8d-f3696c5d5ef3 service nova] Releasing lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:17:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.objects.instance [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:17:56 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Creating image(s)
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Ensure instance console log exists: /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Start _get_guest_xml network_info=[{"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJSQtNZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38b0d9d9-9a05-44e3-bdd1-ac6da28204fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'e22766fe-5c2c-49af-86b6-ec8686d31eb4', 'serial': 'e22766fe-5c2c-49af-86b6-ec8686d31eb4'}, 'attachment_id': '18ec926a-dada-4e9f-bf9a-195f63118f91', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:17:56 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:17:56 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJSQtNZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:17:56 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:17:56 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:17:56 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3a8553-6791-42e3-922c-95219ea3214e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:17:56 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8e9c64-91e7-442c-a600-bf82ffd0e77c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4] added
Nov 30 08:17:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99e7269-42fc-4ca7-a742-6a0be00cda7c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dd9d15-3495-458a-8b88-80a7369fa6e4]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:17:56 user nova-compute[74963]: INFO nova.compute.manager [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Attaching volume 65d1e2f3-3675-4fcd-9bf5-771135fca771 to /dev/vdb
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJSQtNZL {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJSQtNZL" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce6ca3f-552b-4129-b6a8-bd225285373d]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wJSQtNZL'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[764eb82e-5b0c-42b3-95f9-c7d9da44754b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[87891c72-046a-429a-a019-4175d53aa324]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:56 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:17:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:56 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:17:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.utils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6aafdf-8aae-47c4-8d32-dbdd6c5aa14c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d10e81c-6d3e-4ea5-b9a2-dd2439eb7883]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[77095b35-a0b1-4d8f-824d-856bed9a6d0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de27a5e8-5981-47d2-8777-4f307a566e26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ca1092-0f59-462a-9938-bc0fcde93555]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4, portal: 172.16.0.220,3260]
Nov 30 08:17:56 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4, portal: 172.16.0.220,3260] successful.
Nov 30 08:17:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:17:56 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[209459d3-9442-46a7-9e33-63a49980a15e]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.utils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updating existing volume attachment record: b6b81ea5-ce18-42d3-a68e-ddc0e7fa4960 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4a84a9-3b6b-4ee9-80d5-255f7fdd40bc]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[47408012-f77e-4c30-ae07-baa746d46434]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:56 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:17:56 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:17:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:17:56 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:17:56 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:17:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda661ce-b1dc-4338-87b9-6867ebc669af]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:17:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJSQtNZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23636663030633337', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636663030633337', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1543762884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1543762884',id=25,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-ksav8sxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:17:40Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=38b0d9d9-9a05-44e3-bdd1-ac6da28204fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=8bd435ad-5e5a-45c7-8282-3819f0935b25,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd435ad-5e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'pci_devices' on Instance uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:17:57 user nova-compute[74963]:   <uuid>38b0d9d9-9a05-44e3-bdd1-ac6da28204fe</uuid>
Nov 30 08:17:57 user nova-compute[74963]:   <name>instance-00000019</name>
Nov 30 08:17:57 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:17:57 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:17:57 user nova-compute[74963]:   <metadata>
Nov 30 08:17:57 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:17:57 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:17:57 user nova-compute[74963]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1543762884</nova:name>
Nov 30 08:17:57 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:17:56</nova:creationTime>
Nov 30 08:17:57 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:17:57 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:17:57 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:17:57 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:17:57 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:17:57 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:17:57 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:17:57 user nova-compute[74963]:       <nova:owner>
Nov 30 08:17:57 user nova-compute[74963]:         <nova:user uuid="4b110fcb508342509690b45e1854eb81">tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member</nova:user>
Nov 30 08:17:57 user nova-compute[74963]:         <nova:project uuid="ce233bd757b64de4bd6f6abb3230da01">tempest-ServerBootFromVolumeStableRescueTest-1834985655</nova:project>
Nov 30 08:17:57 user nova-compute[74963]:       </nova:owner>
Nov 30 08:17:57 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:17:57 user nova-compute[74963]:       <nova:ports>
Nov 30 08:17:57 user nova-compute[74963]:         <nova:port uuid="8bd435ad-5e5a-45c7-8282-3819f0935b25">
Nov 30 08:17:57 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 08:17:57 user nova-compute[74963]:         </nova:port>
Nov 30 08:17:57 user nova-compute[74963]:       </nova:ports>
Nov 30 08:17:57 user nova-compute[74963]:     </nova:instance>
Nov 30 08:17:57 user nova-compute[74963]:   </metadata>
Nov 30 08:17:57 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:17:57 user nova-compute[74963]:     <system>
Nov 30 08:17:57 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:17:57 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:17:57 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:17:57 user nova-compute[74963]:       <entry name="serial">38b0d9d9-9a05-44e3-bdd1-ac6da28204fe</entry>
Nov 30 08:17:57 user nova-compute[74963]:       <entry name="uuid">38b0d9d9-9a05-44e3-bdd1-ac6da28204fe</entry>
Nov 30 08:17:57 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:17:57 user nova-compute[74963]:     </system>
Nov 30 08:17:57 user nova-compute[74963]:   </sysinfo>
Nov 30 08:17:57 user nova-compute[74963]:   <os>
Nov 30 08:17:57 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:17:57 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:17:57 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:17:57 user nova-compute[74963]:   </os>
Nov 30 08:17:57 user nova-compute[74963]:   <features>
Nov 30 08:17:57 user nova-compute[74963]:     <acpi/>
Nov 30 08:17:57 user nova-compute[74963]:     <apic/>
Nov 30 08:17:57 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:17:57 user nova-compute[74963]:   </features>
Nov 30 08:17:57 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:17:57 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:17:57 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:17:57 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:17:57 user nova-compute[74963]:   </clock>
Nov 30 08:17:57 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:17:57 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:17:57 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:17:57 user nova-compute[74963]:   </cpu>
Nov 30 08:17:57 user nova-compute[74963]:   <devices>
Nov 30 08:17:57 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:17:57 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:17:57 user nova-compute[74963]:       <source dev="/dev/sdc"/>
Nov 30 08:17:57 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:17:57 user nova-compute[74963]:       <serial>e22766fe-5c2c-49af-86b6-ec8686d31eb4</serial>
Nov 30 08:17:57 user nova-compute[74963]:     </disk>
Nov 30 08:17:57 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:17:57 user nova-compute[74963]:       <mac address="fa:16:3e:09:5d:bb"/>
Nov 30 08:17:57 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:17:57 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:17:57 user nova-compute[74963]:       <target dev="tap8bd435ad-5e"/>
Nov 30 08:17:57 user nova-compute[74963]:     </interface>
Nov 30 08:17:57 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:17:57 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/console.log" append="off"/>
Nov 30 08:17:57 user nova-compute[74963]:     </serial>
Nov 30 08:17:57 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:17:57 user nova-compute[74963]:     <video>
Nov 30 08:17:57 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:17:57 user nova-compute[74963]:     </video>
Nov 30 08:17:57 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:17:57 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:17:57 user nova-compute[74963]:     </rng>
Nov 30 08:17:57 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:17:57 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:17:57 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:17:57 user nova-compute[74963]:     </memballoon>
Nov 30 08:17:57 user nova-compute[74963]:   </devices>
Nov 30 08:17:57 user nova-compute[74963]: </domain>
Nov 30 08:17:57 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1543762884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1543762884',id=25,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-ksav8sxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:17:40Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=38b0d9d9-9a05-44e3-bdd1-ac6da28204fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=8bd435ad-5e5a-45c7-8282-3819f0935b25,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd435ad-5e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG os_vif [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=8bd435ad-5e5a-45c7-8282-3819f0935b25,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd435ad-5e') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be94b520-db89-5f8a-ac34-f571f0979d0b', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bd435ad-5e, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bd435ad-5e, col_values=(('qos', UUID('a3eefdee-4022-4e23-97db-59996f294d34')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bd435ad-5e, col_values=(('external_ids', {'iface-id': '8bd435ad-5e5a-45c7-8282-3819f0935b25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:5d:bb', 'vm-uuid': '38b0d9d9-9a05-44e3-bdd1-ac6da28204fe'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:17:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:57 user nova-compute[74963]: INFO os_vif [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=8bd435ad-5e5a-45c7-8282-3819f0935b25,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd435ad-5e')
Nov 30 08:17:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:17:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No VIF found with MAC fa:16:3e:09:5d:bb, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:17:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-4858cf6f-c2f2-43dc-9273-84020cac30ef req-6452e002-bc0b-4548-8745-22dc564957f3 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-changed-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-4858cf6f-c2f2-43dc-9273-84020cac30ef req-6452e002-bc0b-4548-8745-22dc564957f3 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Refreshing instance network info cache due to event network-changed-f76abde2-a558-4cba-a95d-959ac47f8746. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4858cf6f-c2f2-43dc-9273-84020cac30ef req-6452e002-bc0b-4548-8745-22dc564957f3 service nova] Acquiring lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4858cf6f-c2f2-43dc-9273-84020cac30ef req-6452e002-bc0b-4548-8745-22dc564957f3 service nova] Acquired lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-4858cf6f-c2f2-43dc-9273-84020cac30ef req-6452e002-bc0b-4548-8745-22dc564957f3 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Refreshing network info cache for port f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-4858cf6f-c2f2-43dc-9273-84020cac30ef req-6452e002-bc0b-4548-8745-22dc564957f3 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updated VIF entry in instance network info cache for port f76abde2-a558-4cba-a95d-959ac47f8746. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-4858cf6f-c2f2-43dc-9273-84020cac30ef req-6452e002-bc0b-4548-8745-22dc564957f3 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating instance_info_cache with network_info: [{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4858cf6f-c2f2-43dc-9273-84020cac30ef req-6452e002-bc0b-4548-8745-22dc564957f3 service nova] Releasing lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:17:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:18:00 user nova-compute[74963]: INFO nova.compute.manager [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] instance snapshotting
Nov 30 08:18:00 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Beginning live snapshot process
Nov 30 08:18:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json -f qcow2 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json -f qcow2 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:01 user nova-compute[74963]: WARNING nova.compute.manager [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state building and task_state spawning.
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:01 user nova-compute[74963]: WARNING nova.compute.manager [req-68b0b77d-1da2-45e1-b1a0-92db7a41f662 req-419387e3-62a1-4bd4-b9e5-c3374561eb87 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state building and task_state spawning.
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcrd5fhiv/82f846fcbb3346459fa3fdf84d4e5cf7.delta 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcrd5fhiv/82f846fcbb3346459fa3fdf84d4e5cf7.delta 1073741824" returned: 0 in 0.054s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:18:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Instance spawned successfully.
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:01 user nova-compute[74963]: INFO nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 30 08:18:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:18:01 user nova-compute[74963]: INFO nova.compute.manager [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Took 22.73 seconds to build instance.
Nov 30 08:18:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-cad13ebe-bfcb-48ff-afcd-5d369a865271 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.852s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:18:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74963) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 08:18:02 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 08:18:02 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:18:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcrd5fhiv/82f846fcbb3346459fa3fdf84d4e5cf7.delta /opt/stack/data/nova/instances/snapshots/tmpcrd5fhiv/82f846fcbb3346459fa3fdf84d4e5cf7 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcrd5fhiv/82f846fcbb3346459fa3fdf84d4e5cf7.delta /opt/stack/data/nova/instances/snapshots/tmpcrd5fhiv/82f846fcbb3346459fa3fdf84d4e5cf7" returned: 0 in 0.413s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:03 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Snapshot extracted, beginning image upload
Nov 30 08:18:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Snapshot image upload complete
Nov 30 08:18:06 user nova-compute[74963]: INFO nova.compute.manager [None req-687f0203-f900-49aa-a1dc-7948cb6339ff tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Took 5.64 seconds to snapshot the instance on the hypervisor.
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUanhIZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:06 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:06 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:06 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f989d809-1467-4d0a-b8ac-37301ae404e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:18:06 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce2234-a35a-46a5-9a70-74f154784507]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771] added
Nov 30 08:18:06 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[870ee15c-11c4-45ba-b408-92a4b9e3dd57]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40f767d-0b56-4f2e-98e3-8160817a404a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUanhIZx {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUanhIZx" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d6adc9-7769-45d7-aaee-06f121b439b9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUanhIZx'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf44c46-038c-49ff-93e6-a0e1b7dd1026]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6d5a30-b5f6-4ae3-a915-c450b886a662]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:06 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:06 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:06 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:06 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:06 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:06 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f9457b-4fab-46f0-ab96-0af392a630c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260]
Nov 30 08:18:06 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260] successful.
Nov 30 08:18:06 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddce6575-4d44-4b51-bcc2-5ce246298eeb]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[05038cd9-b08f-4587-94a8-d286a86fbc82]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:07 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:07 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:07 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:07 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:07 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:07 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:07 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:07 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9365ea9a-3034-4238-b4e3-a4cd5852ff84]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUanhIZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26336323032643065', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336323032643065', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG nova.objects.instance [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:18:08 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:18:08 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:18:08 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:18:08 user nova-compute[74963]:   <serial>65d1e2f3-3675-4fcd-9bf5-771135fca771</serial>
Nov 30 08:18:08 user nova-compute[74963]: </disk>
Nov 30 08:18:08 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No VIF found with MAC fa:16:3e:c2:ee:25, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fbf966cc-f649-4ab3-80b5-0fb856ea5612 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.160s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2c8f1669-b162-47a6-9fc6-acde254d346b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2c8f1669-b162-47a6-9fc6-acde254d346b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2c8f1669-b162-47a6-9fc6-acde254d346b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2c8f1669-b162-47a6-9fc6-acde254d346b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74963) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2c8f1669-b162-47a6-9fc6-acde254d346b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-e4108649-7b61-480a-b8ca-b1d680a6f493 req-ae4715e9-a9ef-4c89-9c69-245d21fb5213 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-unplugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e4108649-7b61-480a-b8ca-b1d680a6f493 req-ae4715e9-a9ef-4c89-9c69-245d21fb5213 service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e4108649-7b61-480a-b8ca-b1d680a6f493 req-ae4715e9-a9ef-4c89-9c69-245d21fb5213 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e4108649-7b61-480a-b8ca-b1d680a6f493 req-ae4715e9-a9ef-4c89-9c69-245d21fb5213 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-e4108649-7b61-480a-b8ca-b1d680a6f493 req-ae4715e9-a9ef-4c89-9c69-245d21fb5213 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-unplugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:10 user nova-compute[74963]: WARNING nova.compute.manager [req-e4108649-7b61-480a-b8ca-b1d680a6f493 req-ae4715e9-a9ef-4c89-9c69-245d21fb5213 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-unplugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state active and task_state powering-off.
Nov 30 08:18:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:18:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:18:10 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7574MB free_disk=25.045143127441406GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:18:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:10 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance destroyed successfully.
Nov 30 08:18:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2c8f1669-b162-47a6-9fc6-acde254d346b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2c8f1669-b162-47a6-9fc6-acde254d346b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.166s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance fd313577-5b50-48f3-b224-68542b958d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1528211a-3b92-46aa-8512-5c2568f361ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance f4db2f97-c674-4da7-91d8-ed10cf4c964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:18:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-33e7d8c3-1bc3-47ad-a022-6d80f82be22f req-7f2ae868-39e8-4ba9-b307-57383866fd77 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-33e7d8c3-1bc3-47ad-a022-6d80f82be22f req-7f2ae868-39e8-4ba9-b307-57383866fd77 service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-33e7d8c3-1bc3-47ad-a022-6d80f82be22f req-7f2ae868-39e8-4ba9-b307-57383866fd77 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-33e7d8c3-1bc3-47ad-a022-6d80f82be22f req-7f2ae868-39e8-4ba9-b307-57383866fd77 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-33e7d8c3-1bc3-47ad-a022-6d80f82be22f req-7f2ae868-39e8-4ba9-b307-57383866fd77 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:12 user nova-compute[74963]: WARNING nova.compute.manager [req-33e7d8c3-1bc3-47ad-a022-6d80f82be22f req-7f2ae868-39e8-4ba9-b307-57383866fd77 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state stopped and task_state None.
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "89333c12-d47d-4480-a04f-bd502abf3829" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:12 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:18:12 user nova-compute[74963]: INFO nova.compute.claims [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Claim successful on node user
Nov 30 08:18:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updating instance_info_cache with network_info: [{"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:18:13 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:18:13 user nova-compute[74963]: INFO nova.virt.block_device [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Booting with volume bb894f67-d48b-45e4-b30c-726b1fd3d851 at /dev/vda
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.policy [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46e53966f2e443b0a3e0897c52ece8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec828233be45a68aa720e4c5db2307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG os_brick.utils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[294697dd-bb52-41b3-ac11-3dc61e51ebfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98e0aa0-a79e-459c-8344-066c40190cb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.075s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46ff9fa-929b-45f8-839b-c749cc8deaff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9341f3fc-a308-41d2-94a9-d4f6b8f72735]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:18:13 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:18:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ed76f8-b722-4c11-bc10-5dd613cc70eb]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG os_brick.utils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating existing volume attachment record: e4ddd183-efb1-4157-bdd8-ef372f804021 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:18:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:14 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully created port: 20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:18:14 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully created port: 744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:18:15 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully created port: 492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:18:16 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully created port: 6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:18:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully created port: d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:18:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully updated port: 20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:18:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-722a7e0d-1996-47c0-a7b0-dab9dad09f04 req-8c5b93b2-6fe7-4be5-8883-303f15405b58 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-changed-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-722a7e0d-1996-47c0-a7b0-dab9dad09f04 req-8c5b93b2-6fe7-4be5-8883-303f15405b58 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing instance network info cache due to event network-changed-20953d60-33c1-4fc6-a18c-348e973adf58. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:18:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-722a7e0d-1996-47c0-a7b0-dab9dad09f04 req-8c5b93b2-6fe7-4be5-8883-303f15405b58 service nova] Acquiring lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-722a7e0d-1996-47c0-a7b0-dab9dad09f04 req-8c5b93b2-6fe7-4be5-8883-303f15405b58 service nova] Acquired lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:17 user nova-compute[74963]: DEBUG nova.network.neutron [req-722a7e0d-1996-47c0-a7b0-dab9dad09f04 req-8c5b93b2-6fe7-4be5-8883-303f15405b58 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing network info cache for port 20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:18:17 user nova-compute[74963]: DEBUG nova.network.neutron [req-722a7e0d-1996-47c0-a7b0-dab9dad09f04 req-8c5b93b2-6fe7-4be5-8883-303f15405b58 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:18:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:18 user nova-compute[74963]: DEBUG nova.network.neutron [req-722a7e0d-1996-47c0-a7b0-dab9dad09f04 req-8c5b93b2-6fe7-4be5-8883-303f15405b58 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-722a7e0d-1996-47c0-a7b0-dab9dad09f04 req-8c5b93b2-6fe7-4be5-8883-303f15405b58 service nova] Releasing lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:18 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully updated port: 3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:18:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully updated port: 413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:18:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-changed-3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing instance network info cache due to event network-changed-3d981111-1e7a-44c8-8c22-d5c314992081. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:18:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] Acquiring lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] Acquired lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing network info cache for port 3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] Releasing lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-changed-413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing instance network info cache due to event network-changed-413e6908-6d37-4ae6-9817-d0876419a6ea. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] Acquiring lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] Acquired lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing network info cache for port 413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully updated port: 744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-84aee0c4-1432-43fa-bbc6-9230ba854532 req-5fe20138-665c-4d5d-bf2c-681608a6f009 service nova] Releasing lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully updated port: 492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-81256fa8-4304-48b3-83d7-805c93a4f2b9 req-acb98fae-f415-4e0e-9f16-3b28cd7661b7 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received event network-changed-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-81256fa8-4304-48b3-83d7-805c93a4f2b9 req-acb98fae-f415-4e0e-9f16-3b28cd7661b7 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Refreshing instance network info cache due to event network-changed-ff3a0512-18ba-45c2-b1a4-7137ad1ac421. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-81256fa8-4304-48b3-83d7-805c93a4f2b9 req-acb98fae-f415-4e0e-9f16-3b28cd7661b7 service nova] Acquiring lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-81256fa8-4304-48b3-83d7-805c93a4f2b9 req-acb98fae-f415-4e0e-9f16-3b28cd7661b7 service nova] Acquired lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.network.neutron [req-81256fa8-4304-48b3-83d7-805c93a4f2b9 req-acb98fae-f415-4e0e-9f16-3b28cd7661b7 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Refreshing network info cache for port ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.objects.instance [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'flavor' on Instance uuid f4db2f97-c674-4da7-91d8-ed10cf4c964a {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.network.neutron [req-81256fa8-4304-48b3-83d7-805c93a4f2b9 req-acb98fae-f415-4e0e-9f16-3b28cd7661b7 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Updated VIF entry in instance network info cache for port ff3a0512-18ba-45c2-b1a4-7137ad1ac421. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.network.neutron [req-81256fa8-4304-48b3-83d7-805c93a4f2b9 req-acb98fae-f415-4e0e-9f16-3b28cd7661b7 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Updating instance_info_cache with network_info: [{"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-81256fa8-4304-48b3-83d7-805c93a4f2b9 req-acb98fae-f415-4e0e-9f16-3b28cd7661b7 service nova] Releasing lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-changed-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing instance network info cache due to event network-changed-744f8361-9013-4250-8f88-e68375c254fe. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] Acquiring lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] Acquired lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG nova.network.neutron [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing network info cache for port 744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:21 user nova-compute[74963]: INFO nova.compute.manager [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Attaching volume 979b04e6-b037-4a3b-bd1c-7987c08b46a4 to /dev/vdb
Nov 30 08:18:22 user nova-compute[74963]: DEBUG os_brick.utils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[47252306-47ca-4749-b98c-a02faadfc040]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23c6765-edb5-4d3d-b0ab-755a0ef26eca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8710241-5745-44ac-8a2f-27d975130921]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac746142-8d42-4cf1-9540-0c7af62ae629]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:18:22 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bf6a4c-362f-4e42-8112-ce6d30ea5fce]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG os_brick.utils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Updating existing volume attachment record: 9b641450-dbc2-450b-9fb4-f4c0e7e6c142 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully updated port: 6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] Releasing lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-changed-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing instance network info cache due to event network-changed-492dda05-4f87-4006-be77-1365e29ebc9e. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] Acquiring lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] Acquired lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing network info cache for port 492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffff6ca2-cded-48f9-8665-1853a152bb4e req-bbf2c6be-46c0-4b65-a21f-93b90501a648 service nova] Releasing lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Successfully updated port: d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:18:23 user nova-compute[74963]: INFO nova.virt.block_device [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Booting with volume cf43e2db-5977-4b99-9abe-572574b07879 at /dev/vdb
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquired lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG os_brick.utils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[604a69a9-f630-4b0e-a530-1d86bd199c4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e92186-1999-4779-8541-eeb966850a03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94bfe2f-56dc-4b43-9791-68d650330d48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7127c6ef-796b-438d-83c2-a8c467396889]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:18:23 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:18:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad55a69e-e9ee-4eed-bd1d-8772c8001cdb]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG os_brick.utils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating existing volume attachment record: 99d61b1a-383f-47b9-ac6c-d82279d057b2 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:18:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-changed-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing instance network info cache due to event network-changed-6792760d-62a9-4138-a559-dede30e285a7. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:18:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] Acquiring lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:25 user nova-compute[74963]: DEBUG nova.network.neutron [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [{"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Releasing lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance network_info: |[{"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:18:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] Acquired lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:25 user nova-compute[74963]: DEBUG nova.network.neutron [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing network info cache for port 6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updated VIF entry in instance network info cache for port 6792760d-62a9-4138-a559-dede30e285a7. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [{"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] Releasing lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-changed-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing instance network info cache due to event network-changed-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] Acquiring lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] Acquired lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing network info cache for port d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updated VIF entry in instance network info cache for port d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [{"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:18:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-06de5a46-d550-4405-8d6b-3813bf026cbb req-90202463-cdf1-4bb7-b906-bacd9a5bc4b6 service nova] Releasing lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:18:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbnwozXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:31 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:31 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:31 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c8888b-1682-4dc1-ba92-157738a68946]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:18:31 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfae9ceb-8862-44a3-abfb-ea5abd8ba0bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4] added
Nov 30 08:18:31 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2372bb98-3e3e-4060-9a6b-d8781ec15bb6]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[70947505-cc0c-42c3-89ac-0df89eec35ee]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbnwozXD {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbnwozXD" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[515b09e8-b280-4d73-8464-0b9a3c12e451]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbnwozXD'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[665b2823-f019-4325-a37a-0c4615330e88]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dc0292-05e9-4d82-a5e4-2fb61256ee0a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3386e8f-4e75-4fad-b12b-dffc32f0c209]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4, portal: 172.16.0.220,3260]
Nov 30 08:18:31 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4, portal: 172.16.0.220,3260] successful.
Nov 30 08:18:31 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d43ae1-a4f9-4837-a158-e7bb8c31b24d]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a192d7-c0ab-4054-8032-a96be6d038e9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:31 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3330ac-0d3d-441d-b4e8-84c3085d695a]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:31 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: None {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:18:32 user nova-compute[74963]: INFO nova.virt.block_device [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Booting with volume af1c616f-ac1a-453a-9031-bb65b789afc4 at /dev/vdc
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.utils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbnwozXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23066333561393836', 'path': '/dev/sdf'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066333561393836', 'path': '/dev/sdf'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc54f9fe-062b-4fe1-a6e8-036473a91267]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG nova.objects.instance [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'flavor' on Instance uuid f4db2f97-c674-4da7-91d8-ed10cf4c964a {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4233d2-09fe-4504-9372-e3b79232549a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:18:32 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:18:32 user nova-compute[74963]:   <source dev="/dev/sdf"/>
Nov 30 08:18:32 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:18:32 user nova-compute[74963]:   <serial>979b04e6-b037-4a3b-bd1c-7987c08b46a4</serial>
Nov 30 08:18:32 user nova-compute[74963]: </disk>
Nov 30 08:18:32 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6594ea76-1f4c-4413-8aca-f76e079170c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54aee4f-2f64-4b9b-b140-a083bdb25630]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:18:32 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:18:32 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb249559-e870-4a4f-b27d-d2f5f35a7e8b]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG os_brick.utils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:32 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating existing volume attachment record: dc51e11b-5e2b-4a46-aad9-91cc7d3e2a45 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:18:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:18:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:18:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] No VIF found with MAC fa:16:3e:92:be:4d, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:18:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-967852c9-759a-40cb-92db-beab815a5f94 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.264s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:35 user nova-compute[74963]: INFO nova.compute.manager [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Detaching volume 979b04e6-b037-4a3b-bd1c-7987c08b46a4
Nov 30 08:18:35 user nova-compute[74963]: INFO nova.virt.block_device [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Attempting to driver detach volume 979b04e6-b037-4a3b-bd1c-7987c08b46a4 from mountpoint /dev/vdb
Nov 30 08:18:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Attempting to detach device vdb from instance f4db2f97-c674-4da7-91d8-ed10cf4c964a from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:18:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:18:35 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:18:35 user nova-compute[74963]:   <source dev="/dev/sdf"/>
Nov 30 08:18:35 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:18:35 user nova-compute[74963]:   <serial>979b04e6-b037-4a3b-bd1c-7987c08b46a4</serial>
Nov 30 08:18:35 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:18:35 user nova-compute[74963]: </disk>
Nov 30 08:18:35 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:18:35 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Successfully detached device vdb from instance f4db2f97-c674-4da7-91d8-ed10cf4c964a from the persistent domain config.
Nov 30 08:18:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4db2f97-c674-4da7-91d8-ed10cf4c964a from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:18:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:18:35 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:18:35 user nova-compute[74963]:   <source dev="/dev/sdf"/>
Nov 30 08:18:35 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:18:35 user nova-compute[74963]:   <serial>979b04e6-b037-4a3b-bd1c-7987c08b46a4</serial>
Nov 30 08:18:35 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:18:35 user nova-compute[74963]: </disk>
Nov 30 08:18:35 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:18:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4db2f97-c674-4da7-91d8-ed10cf4c964a {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:18:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:18:41 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Creating image(s)
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Ensure instance console log exists: /opt/stack/data/nova/instances/89333c12-d47d-4480-a04f-bd502abf3829/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Start _get_guest_xml network_info=[{"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgDVXCKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89333c12-d47d-4480-a04f-bd502abf3829', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb894f67-d48b-45e4-b30c-726b1fd3d851', 'serial': 'bb894f67-d48b-45e4-b30c-726b1fd3d851'}, 'attachment_id': 'e4ddd183-efb1-4157-bdd8-ef372f804021', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUyAgklq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89333c12-d47d-4480-a04f-bd502abf3829', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf43e2db-5977-4b99-9abe-572574b07879', 'serial': 'cf43e2db-5977-4b99-9abe-572574b07879'}, 'attachment_id': '99d61b1a-383f-47b9-ac6c-d82279d057b2', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdTQhzVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89333c12-d47d-4480-a04f-bd502abf3829', 'attached_at': '', 'detached_at': '', 'volume_id': 'af1c616f-ac1a-453a-9031-bb65b789afc4', 'serial': 'af1c616f-ac1a-453a-9031-bb65b789afc4'}, 'attachment_id': 'dc51e11b-5e2b-4a46-aad9-91cc7d3e2a45', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:18:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:18:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgDVXCKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:41 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:41 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:41 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed2ce3-9045-43ab-9204-d0364458103c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:18:41 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[821486b4-a2b0-476a-bd76-9a039b4dac36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851] added
Nov 30 08:18:41 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[35980572-eb27-45ea-a75b-b2c05228e7a1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577373e-056d-4259-9e8c-ec91aded5a81]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgDVXCKP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgDVXCKP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f6da9-6875-4af4-8c5c-acecc5cc4abb]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lgDVXCKP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[40929f6e-e9b7-4163-8225-b49616393803]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d0a46b-01ec-4aec-97c3-fa2562f7129d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[df83003f-2627-41f0-9641-564d8e12b284]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851, portal: 172.16.0.220,3260]
Nov 30 08:18:42 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851, portal: 172.16.0.220,3260] successful.
Nov 30 08:18:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.045s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[431c49ff-bcfc-45a3-97b5-6b1c2017d08a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff87350-fa05-406b-9b8f-f7f90a8702c9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fae989-3e8f-466a-83ab-df0cef3ceaed]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:18:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgDVXCKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26636636363623865', 'path': '/dev/sdg'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636636363623865', 'path': '/dev/sdg'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUyAgklq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:43 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:43 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:43 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ee4d61-a1de-4ddc-9b8d-5bb42c402a0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:18:43 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf20be1-a8db-4dcc-91bb-b86418731689]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879] added
Nov 30 08:18:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c08acdd-157c-4b9f-8585-8b0062f75c4d]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a91aabc-1ad0-4fbb-a4f2-caba9aadc73a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUyAgklq {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUyAgklq" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e77ebe9-7929-46ec-8dcb-1486908c99fb]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aUyAgklq'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9093ccd-04db-4a48-be0b-62e5103cb284]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d2b41a-9d2b-48b0-8198-74222221b43d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[861f600f-60e9-4327-8d37-27d59efd0201]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879, portal: 172.16.0.220,3260]
Nov 30 08:18:43 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879, portal: 172.16.0.220,3260] successful.
Nov 30 08:18:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc54314-fa07-4091-ac9e-f59d4467931e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c6859d-ede3-4993-809d-825bc5afde5b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:18:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] HCTL ('39', '-', '-', 0) found on session 28 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f154456-6c7e-437b-b16f-50b0d616a009]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Searching for a device in session 28 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:18:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUyAgklq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26562366438666334', 'path': '/dev/sdh'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562366438666334', 'path': '/dev/sdh'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdTQhzVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:44 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:44 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:44 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8209d42-05d1-4b6e-93e9-1aef07934f62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:18:44 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d4df36-30bf-4307-b19f-7027f3fd7ae3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4] added
Nov 30 08:18:44 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e0e0c5-c331-49c9-b027-abaad9d75a76]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3229fd3-a2cb-471a-aef2-1ba96e483579]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdTQhzVK {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdTQhzVK" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[900801d5-a12f-4a41-b6b0-c4e51554d462]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IdTQhzVK'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dca1c8-cc15-485d-8196-3348efb8314e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[114c1f84-747f-451e-886d-288809762d6d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:18:44 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce227ba-4316-4f68-a040-b3b11fba8a5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4, portal: 172.16.0.220,3260]
Nov 30 08:18:44 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4, portal: 172.16.0.220,3260] successful.
Nov 30 08:18:44 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a21946-65cf-4b9d-9918-04a9bfd33ad2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[58136193-7d30-4fae-8377-bd084e7573de]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:18:45 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] HCTL ('40', '-', '-', 0) found on session 29 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf19187-58a5-4bf4-825e-3e42aa73cec7]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Searching for a device in session 29 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:18:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdTQhzVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23766376533623535', 'path': '/dev/sdi'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766376533623535', 'path': '/dev/sdi'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:e6,bridge_name='br-int',has_traffic_filtering=True,id=20953d60-33c1-4fc6-a18c-348e973adf58,network=Network(b7682c3a-2150-407c-af83-12a9f0331bef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20953d60-33') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:90:01,bridge_name='br-int',has_traffic_filtering=True,id=3d981111-1e7a-44c8-8c22-d5c314992081,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d981111-1e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=413e6908-6d37-4ae6-9817-d0876419a6ea,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap413e6908-6d') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b9:9d,bridge_name='br-int',has_traffic_filtering=True,id=744f8361-9013-4250-8f88-e68375c254fe,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8361-90') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ce:c0,bridge_name='br-int',has_traffic_filtering=True,id=492dda05-4f87-4006-be77-1365e29ebc9e,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492dda05-4f') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:17:79,bridge_name='br-int',has_traffic_filtering=True,id=6792760d-62a9-4138-a559-dede30e285a7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6792760d-62') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d0:3e,bridge_name='br-int',has_traffic_filtering=True,id=d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dd9dd9-dd') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.objects.instance [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lazy-loading 'pci_devices' on Instance uuid 89333c12-d47d-4480-a04f-bd502abf3829 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:18:46 user nova-compute[74963]:   <uuid>89333c12-d47d-4480-a04f-bd502abf3829</uuid>
Nov 30 08:18:46 user nova-compute[74963]:   <name>instance-0000001a</name>
Nov 30 08:18:46 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:18:46 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:18:46 user nova-compute[74963]:   <metadata>
Nov 30 08:18:46 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:18:46 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:18:46 user nova-compute[74963]:       <nova:name>tempest-device-tagging-server-1556095200</nova:name>
Nov 30 08:18:46 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:18:41</nova:creationTime>
Nov 30 08:18:46 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:18:46 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:18:46 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:18:46 user nova-compute[74963]:       <nova:owner>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:user uuid="46e53966f2e443b0a3e0897c52ece8b8">tempest-TaggedBootDevicesTest-297210878-project-member</nova:user>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:project uuid="a4ec828233be45a68aa720e4c5db2307">tempest-TaggedBootDevicesTest-297210878</nova:project>
Nov 30 08:18:46 user nova-compute[74963]:       </nova:owner>
Nov 30 08:18:46 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:18:46 user nova-compute[74963]:       <nova:ports>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:port uuid="20953d60-33c1-4fc6-a18c-348e973adf58">
Nov 30 08:18:46 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 08:18:46 user nova-compute[74963]:         </nova:port>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:port uuid="3d981111-1e7a-44c8-8c22-d5c314992081">
Nov 30 08:18:46 user nova-compute[74963]:           <nova:ip type="fixed" address="10.1.1.168" ipVersion="4"/>
Nov 30 08:18:46 user nova-compute[74963]:         </nova:port>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:port uuid="413e6908-6d37-4ae6-9817-d0876419a6ea">
Nov 30 08:18:46 user nova-compute[74963]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Nov 30 08:18:46 user nova-compute[74963]:         </nova:port>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:port uuid="744f8361-9013-4250-8f88-e68375c254fe">
Nov 30 08:18:46 user nova-compute[74963]:           <nova:ip type="fixed" address="10.1.1.212" ipVersion="4"/>
Nov 30 08:18:46 user nova-compute[74963]:         </nova:port>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:port uuid="492dda05-4f87-4006-be77-1365e29ebc9e">
Nov 30 08:18:46 user nova-compute[74963]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Nov 30 08:18:46 user nova-compute[74963]:         </nova:port>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:port uuid="6792760d-62a9-4138-a559-dede30e285a7">
Nov 30 08:18:46 user nova-compute[74963]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 30 08:18:46 user nova-compute[74963]:         </nova:port>
Nov 30 08:18:46 user nova-compute[74963]:         <nova:port uuid="d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7">
Nov 30 08:18:46 user nova-compute[74963]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 30 08:18:46 user nova-compute[74963]:         </nova:port>
Nov 30 08:18:46 user nova-compute[74963]:       </nova:ports>
Nov 30 08:18:46 user nova-compute[74963]:     </nova:instance>
Nov 30 08:18:46 user nova-compute[74963]:   </metadata>
Nov 30 08:18:46 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:18:46 user nova-compute[74963]:     <system>
Nov 30 08:18:46 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:18:46 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:18:46 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:18:46 user nova-compute[74963]:       <entry name="serial">89333c12-d47d-4480-a04f-bd502abf3829</entry>
Nov 30 08:18:46 user nova-compute[74963]:       <entry name="uuid">89333c12-d47d-4480-a04f-bd502abf3829</entry>
Nov 30 08:18:46 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:18:46 user nova-compute[74963]:     </system>
Nov 30 08:18:46 user nova-compute[74963]:   </sysinfo>
Nov 30 08:18:46 user nova-compute[74963]:   <os>
Nov 30 08:18:46 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:18:46 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:18:46 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:18:46 user nova-compute[74963]:   </os>
Nov 30 08:18:46 user nova-compute[74963]:   <features>
Nov 30 08:18:46 user nova-compute[74963]:     <acpi/>
Nov 30 08:18:46 user nova-compute[74963]:     <apic/>
Nov 30 08:18:46 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:18:46 user nova-compute[74963]:   </features>
Nov 30 08:18:46 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:18:46 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:18:46 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:18:46 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:18:46 user nova-compute[74963]:   </clock>
Nov 30 08:18:46 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:18:46 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:18:46 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:18:46 user nova-compute[74963]:   </cpu>
Nov 30 08:18:46 user nova-compute[74963]:   <devices>
Nov 30 08:18:46 user nova-compute[74963]:     <disk type="file" device="cdrom">
Nov 30 08:18:46 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 08:18:46 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/89333c12-d47d-4480-a04f-bd502abf3829/disk.config"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="hda" bus="ide"/>
Nov 30 08:18:46 user nova-compute[74963]:     </disk>
Nov 30 08:18:46 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:18:46 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:18:46 user nova-compute[74963]:       <source dev="/dev/sdg"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <serial>bb894f67-d48b-45e4-b30c-726b1fd3d851</serial>
Nov 30 08:18:46 user nova-compute[74963]:     </disk>
Nov 30 08:18:46 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:18:46 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:18:46 user nova-compute[74963]:       <source dev="/dev/sdh"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <serial>cf43e2db-5977-4b99-9abe-572574b07879</serial>
Nov 30 08:18:46 user nova-compute[74963]:     </disk>
Nov 30 08:18:46 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:18:46 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:18:46 user nova-compute[74963]:       <source dev="/dev/sdi"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="vdc" bus="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <serial>af1c616f-ac1a-453a-9031-bb65b789afc4</serial>
Nov 30 08:18:46 user nova-compute[74963]:     </disk>
Nov 30 08:18:46 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:18:46 user nova-compute[74963]:       <mac address="fa:16:3e:2e:8f:e6"/>
Nov 30 08:18:46 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="tap20953d60-33"/>
Nov 30 08:18:46 user nova-compute[74963]:     </interface>
Nov 30 08:18:46 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:18:46 user nova-compute[74963]:       <mac address="fa:16:3e:35:90:01"/>
Nov 30 08:18:46 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="tap3d981111-1e"/>
Nov 30 08:18:46 user nova-compute[74963]:     </interface>
Nov 30 08:18:46 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:18:46 user nova-compute[74963]:       <mac address="fa:16:3e:16:ee:69"/>
Nov 30 08:18:46 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="tap413e6908-6d"/>
Nov 30 08:18:46 user nova-compute[74963]:     </interface>
Nov 30 08:18:46 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:18:46 user nova-compute[74963]:       <mac address="fa:16:3e:11:b9:9d"/>
Nov 30 08:18:46 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="tap744f8361-90"/>
Nov 30 08:18:46 user nova-compute[74963]:     </interface>
Nov 30 08:18:46 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:18:46 user nova-compute[74963]:       <mac address="fa:16:3e:bd:ce:c0"/>
Nov 30 08:18:46 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="tap492dda05-4f"/>
Nov 30 08:18:46 user nova-compute[74963]:     </interface>
Nov 30 08:18:46 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:18:46 user nova-compute[74963]:       <mac address="fa:16:3e:c7:17:79"/>
Nov 30 08:18:46 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="tap6792760d-62"/>
Nov 30 08:18:46 user nova-compute[74963]:     </interface>
Nov 30 08:18:46 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:18:46 user nova-compute[74963]:       <mac address="fa:16:3e:bb:d0:3e"/>
Nov 30 08:18:46 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:18:46 user nova-compute[74963]:       <target dev="tapd3dd9dd9-dd"/>
Nov 30 08:18:46 user nova-compute[74963]:     </interface>
Nov 30 08:18:46 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:18:46 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/89333c12-d47d-4480-a04f-bd502abf3829/console.log" append="off"/>
Nov 30 08:18:46 user nova-compute[74963]:     </serial>
Nov 30 08:18:46 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:18:46 user nova-compute[74963]:     <video>
Nov 30 08:18:46 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:18:46 user nova-compute[74963]:     </video>
Nov 30 08:18:46 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:18:46 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:18:46 user nova-compute[74963]:     </rng>
Nov 30 08:18:46 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:18:46 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:18:46 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:18:46 user nova-compute[74963]:     </memballoon>
Nov 30 08:18:46 user nova-compute[74963]:   </devices>
Nov 30 08:18:46 user nova-compute[74963]: </domain>
Nov 30 08:18:46 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:e6,bridge_name='br-int',has_traffic_filtering=True,id=20953d60-33c1-4fc6-a18c-348e973adf58,network=Network(b7682c3a-2150-407c-af83-12a9f0331bef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20953d60-33') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:e6,bridge_name='br-int',has_traffic_filtering=True,id=20953d60-33c1-4fc6-a18c-348e973adf58,network=Network(b7682c3a-2150-407c-af83-12a9f0331bef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20953d60-33') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96ed21b3-3831-586f-af77-0005a6e7035a', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20953d60-33, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20953d60-33, col_values=(('qos', UUID('6b3d8b09-4a7a-420d-8d95-03b6d87c9283')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20953d60-33, col_values=(('external_ids', {'iface-id': '20953d60-33c1-4fc6-a18c-348e973adf58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:8f:e6', 'vm-uuid': '89333c12-d47d-4480-a04f-bd502abf3829'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: INFO os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:e6,bridge_name='br-int',has_traffic_filtering=True,id=20953d60-33c1-4fc6-a18c-348e973adf58,network=Network(b7682c3a-2150-407c-af83-12a9f0331bef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20953d60-33')
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:90:01,bridge_name='br-int',has_traffic_filtering=True,id=3d981111-1e7a-44c8-8c22-d5c314992081,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d981111-1e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:90:01,bridge_name='br-int',has_traffic_filtering=True,id=3d981111-1e7a-44c8-8c22-d5c314992081,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d981111-1e') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69ae9df2-780a-5de2-af57-a01bd6cb9b22', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d981111-1e, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d981111-1e, col_values=(('qos', UUID('e0c7ba6a-e7d7-4c36-a5b5-21d3639e233a')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d981111-1e, col_values=(('external_ids', {'iface-id': '3d981111-1e7a-44c8-8c22-d5c314992081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:90:01', 'vm-uuid': '89333c12-d47d-4480-a04f-bd502abf3829'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: INFO os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:90:01,bridge_name='br-int',has_traffic_filtering=True,id=3d981111-1e7a-44c8-8c22-d5c314992081,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d981111-1e')
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=413e6908-6d37-4ae6-9817-d0876419a6ea,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap413e6908-6d') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=413e6908-6d37-4ae6-9817-d0876419a6ea,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap413e6908-6d') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cc0ca1d-2fe0-5a5e-b7ba-3e670e44b6f2', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap413e6908-6d, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap413e6908-6d, col_values=(('qos', UUID('80f6d509-00d8-47a4-af95-95e3064e5cea')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap413e6908-6d, col_values=(('external_ids', {'iface-id': '413e6908-6d37-4ae6-9817-d0876419a6ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:ee:69', 'vm-uuid': '89333c12-d47d-4480-a04f-bd502abf3829'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: INFO os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=413e6908-6d37-4ae6-9817-d0876419a6ea,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap413e6908-6d')
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b9:9d,bridge_name='br-int',has_traffic_filtering=True,id=744f8361-9013-4250-8f88-e68375c254fe,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8361-90') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b9:9d,bridge_name='br-int',has_traffic_filtering=True,id=744f8361-9013-4250-8f88-e68375c254fe,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8361-90') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8cdea9a-a948-5903-a074-b3f2a6ea6772', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap744f8361-90, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap744f8361-90, col_values=(('qos', UUID('71eaf2fb-9b16-4399-9b27-ab34d9dac044')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap744f8361-90, col_values=(('external_ids', {'iface-id': '744f8361-9013-4250-8f88-e68375c254fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:b9:9d', 'vm-uuid': '89333c12-d47d-4480-a04f-bd502abf3829'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: INFO os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b9:9d,bridge_name='br-int',has_traffic_filtering=True,id=744f8361-9013-4250-8f88-e68375c254fe,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8361-90')
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ce:c0,bridge_name='br-int',has_traffic_filtering=True,id=492dda05-4f87-4006-be77-1365e29ebc9e,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492dda05-4f') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ce:c0,bridge_name='br-int',has_traffic_filtering=True,id=492dda05-4f87-4006-be77-1365e29ebc9e,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492dda05-4f') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84d21c4e-47c3-5956-ad1f-daad25b610d9', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap492dda05-4f, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap492dda05-4f, col_values=(('qos', UUID('3898c4a1-37ce-4478-b9b4-c38afdb08a44')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap492dda05-4f, col_values=(('external_ids', {'iface-id': '492dda05-4f87-4006-be77-1365e29ebc9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:ce:c0', 'vm-uuid': '89333c12-d47d-4480-a04f-bd502abf3829'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: INFO os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ce:c0,bridge_name='br-int',has_traffic_filtering=True,id=492dda05-4f87-4006-be77-1365e29ebc9e,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492dda05-4f')
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:17:79,bridge_name='br-int',has_traffic_filtering=True,id=6792760d-62a9-4138-a559-dede30e285a7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6792760d-62') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:17:79,bridge_name='br-int',has_traffic_filtering=True,id=6792760d-62a9-4138-a559-dede30e285a7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6792760d-62') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b321564-0a7a-5f1e-9697-edfdb6e37dcf', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6792760d-62, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6792760d-62, col_values=(('qos', UUID('a0bbb822-8b7e-4d19-8c3e-5eec50477c49')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6792760d-62, col_values=(('external_ids', {'iface-id': '6792760d-62a9-4138-a559-dede30e285a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:17:79', 'vm-uuid': '89333c12-d47d-4480-a04f-bd502abf3829'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: INFO os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:17:79,bridge_name='br-int',has_traffic_filtering=True,id=6792760d-62a9-4138-a559-dede30e285a7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6792760d-62')
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d0:3e,bridge_name='br-int',has_traffic_filtering=True,id=d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dd9dd9-dd') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d0:3e,bridge_name='br-int',has_traffic_filtering=True,id=d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dd9dd9-dd') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2ea8e6f-c875-5d51-9f6f-72ff8b829837', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3dd9dd9-dd, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3dd9dd9-dd, col_values=(('qos', UUID('1daf967f-981d-4e7c-86ef-6814ae5f7210')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3dd9dd9-dd, col_values=(('external_ids', {'iface-id': 'd3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:d0:3e', 'vm-uuid': '89333c12-d47d-4480-a04f-bd502abf3829'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:46 user nova-compute[74963]: INFO os_vif [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d0:3e,bridge_name='br-int',has_traffic_filtering=True,id=d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dd9dd9-dd')
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] No BDM found with device name hda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] No VIF found with MAC fa:16:3e:2e:8f:e6, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:18:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] No VIF found with MAC fa:16:3e:bd:ce:c0, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:18:46 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Using config drive
Nov 30 08:18:47 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Creating config drive at /opt/stack/data/nova/instances/89333c12-d47d-4480-a04f-bd502abf3829/disk.config
Nov 30 08:18:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/89333c12-d47d-4480-a04f-bd502abf3829/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7psh89ui {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:47 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/89333c12-d47d-4480-a04f-bd502abf3829/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7psh89ui" returned: 0 in 0.060s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-8f16e93b-1081-4223-9a2c-33d0ed4dd053 req-6ba767f7-3bf6-48b2-b900-5441427fda33 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8f16e93b-1081-4223-9a2c-33d0ed4dd053 req-6ba767f7-3bf6-48b2-b900-5441427fda33 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8f16e93b-1081-4223-9a2c-33d0ed4dd053 req-6ba767f7-3bf6-48b2-b900-5441427fda33 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8f16e93b-1081-4223-9a2c-33d0ed4dd053 req-6ba767f7-3bf6-48b2-b900-5441427fda33 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-8f16e93b-1081-4223-9a2c-33d0ed4dd053 req-6ba767f7-3bf6-48b2-b900-5441427fda33 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:48 user nova-compute[74963]: WARNING nova.compute.manager [req-8f16e93b-1081-4223-9a2c-33d0ed4dd053 req-6ba767f7-3bf6-48b2-b900-5441427fda33 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-20953d60-33c1-4fc6-a18c-348e973adf58 for instance with vm_state building and task_state spawning.
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-0d8f8061-6a8c-4b78-a29d-1a1d98fa293a req-3b36de61-a9e7-416d-b48f-4035b4c2db3b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0d8f8061-6a8c-4b78-a29d-1a1d98fa293a req-3b36de61-a9e7-416d-b48f-4035b4c2db3b service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0d8f8061-6a8c-4b78-a29d-1a1d98fa293a req-3b36de61-a9e7-416d-b48f-4035b4c2db3b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0d8f8061-6a8c-4b78-a29d-1a1d98fa293a req-3b36de61-a9e7-416d-b48f-4035b4c2db3b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-0d8f8061-6a8c-4b78-a29d-1a1d98fa293a req-3b36de61-a9e7-416d-b48f-4035b4c2db3b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:49 user nova-compute[74963]: WARNING nova.compute.manager [req-0d8f8061-6a8c-4b78-a29d-1a1d98fa293a req-3b36de61-a9e7-416d-b48f-4035b4c2db3b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-3d981111-1e7a-44c8-8c22-d5c314992081 for instance with vm_state building and task_state spawning.
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-6d34a17a-44b2-4137-ac62-c8e2cccaceb5 req-50997c6e-8e8f-46b0-a895-e4061489eaa6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6d34a17a-44b2-4137-ac62-c8e2cccaceb5 req-50997c6e-8e8f-46b0-a895-e4061489eaa6 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6d34a17a-44b2-4137-ac62-c8e2cccaceb5 req-50997c6e-8e8f-46b0-a895-e4061489eaa6 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6d34a17a-44b2-4137-ac62-c8e2cccaceb5 req-50997c6e-8e8f-46b0-a895-e4061489eaa6 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-6d34a17a-44b2-4137-ac62-c8e2cccaceb5 req-50997c6e-8e8f-46b0-a895-e4061489eaa6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:49 user nova-compute[74963]: WARNING nova.compute.manager [req-6d34a17a-44b2-4137-ac62-c8e2cccaceb5 req-50997c6e-8e8f-46b0-a895-e4061489eaa6 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-413e6908-6d37-4ae6-9817-d0876419a6ea for instance with vm_state building and task_state spawning.
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-20953d60-33c1-4fc6-a18c-348e973adf58 for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-492dda05-4f87-4006-be77-1365e29ebc9e for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-492dda05-4f87-4006-be77-1365e29ebc9e for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-01df1ea5-2b0e-4299-b85f-934ae1777e7c req-f088de7f-cfbc-4823-9425-ccf82790defb service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-3d981111-1e7a-44c8-8c22-d5c314992081 for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-6792760d-62a9-4138-a559-dede30e285a7 for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-d2575e5e-5be8-4791-ba23-b796bd190531 req-cf25ccc6-3ed1-4ab7-84d3-ce128ea61719 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-6792760d-62a9-4138-a559-dede30e285a7 for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-413e6908-6d37-4ae6-9817-d0876419a6ea for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-744f8361-9013-4250-8f88-e68375c254fe for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:51 user nova-compute[74963]: WARNING nova.compute.manager [req-3592cb60-ee0f-4bda-bd84-d85e1695fd81 req-26ac5db9-68de-483d-b018-f7ca25ee4044 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-744f8361-9013-4250-8f88-e68375c254fe for instance with vm_state building and task_state spawning.
Nov 30 08:18:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:18:52 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance spawned successfully.
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:18:52 user nova-compute[74963]: INFO nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Took 11.12 seconds to spawn the instance on the hypervisor.
Nov 30 08:18:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:18:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-a8afb83d-0dc8-4449-b6a0-a1011b926526 req-ed3a7c8d-364a-42a5-9f6b-2db5b0219f7f service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:18:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a8afb83d-0dc8-4449-b6a0-a1011b926526 req-ed3a7c8d-364a-42a5-9f6b-2db5b0219f7f service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:18:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a8afb83d-0dc8-4449-b6a0-a1011b926526 req-ed3a7c8d-364a-42a5-9f6b-2db5b0219f7f service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:18:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a8afb83d-0dc8-4449-b6a0-a1011b926526 req-ed3a7c8d-364a-42a5-9f6b-2db5b0219f7f service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-a8afb83d-0dc8-4449-b6a0-a1011b926526 req-ed3a7c8d-364a-42a5-9f6b-2db5b0219f7f service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:18:53 user nova-compute[74963]: WARNING nova.compute.manager [req-a8afb83d-0dc8-4449-b6a0-a1011b926526 req-ed3a7c8d-364a-42a5-9f6b-2db5b0219f7f service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 for instance with vm_state building and task_state spawning.
Nov 30 08:18:53 user nova-compute[74963]: INFO nova.compute.manager [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Took 40.40 seconds to build instance.
Nov 30 08:18:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6a8600ee-9913-4ff8-830a-9eba0775fce6 tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "89333c12-d47d-4480-a04f-bd502abf3829" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.494s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:18:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:55 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4db2f97-c674-4da7-91d8-ed10cf4c964a is timed out.
Nov 30 08:18:55 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Successfully detached device vdb from instance f4db2f97-c674-4da7-91d8-ed10cf4c964a from the live domain config.
Nov 30 08:18:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbnwozXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:18:55 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:18:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[12deb903-92a9-477f-ab15-6a4aee518e83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:18:55 user nova-compute[74963]: No targets found.
Nov 30 08:18:55 user nova-compute[74963]: iSNS:
Nov 30 08:18:55 user nova-compute[74963]: No targets found.
Nov 30 08:18:55 user nova-compute[74963]: STATIC:
Nov 30 08:18:55 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:18:55 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:18:55 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:18:55 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff
Nov 30 08:18:55 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:18:55 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:18:55 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879
Nov 30 08:18:55 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:18:55 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:18:55 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851
Nov 30 08:18:55 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:18:55 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:18:55 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771
Nov 30 08:18:55 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:18:55 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:18:55 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4
Nov 30 08:18:55 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:18:55 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:18:55 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4
Nov 30 08:18:55 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:18:55 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:18:55 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:18:55 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:18:55 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:18:55 user nova-compute[74963]: FIRMWARE:
Nov 30 08:18:55 user nova-compute[74963]: No targets found.
Nov 30 08:18:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:18:55 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:18:55 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a788be91-1b5b-49f1-9b86-70c15849a814]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff91053d-a684-45d3-aae7-8d5563e7f342]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:18:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:18:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62444a2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4'): ({'sdf'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Removing single pathed devices sdf {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2644a6-3574-4087-b723-968e071524bb]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6114df95-745b-4eee-8556-2ba96a0d293d]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Flushing IO for device /dev/sdf {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de807f34-8263-485e-816d-d0e2b568f2ee]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8262035-710c-41e2-9b36-2c7f6e9e3069]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43c077a-3b81-4890-8628-8ad1004a1e6e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[43533ec3-c5ca-46a4-a614-b85708962530]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4, portal: 172.16.0.220,3260]
Nov 30 08:18:56 user nova-compute[74963]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4, portal: 172.16.0.220,3260] successful.
Nov 30 08:18:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979b04e6-b037-4a3b-bd1c-7987c08b46a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad56c6e-eaab-4a96-8cf2-89ef973a2dba]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] <== disconnect_volume: return (382ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:18:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:18:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'flavor' on Instance uuid f4db2f97-c674-4da7-91d8-ed10cf4c964a {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:18:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d4f7402a-1083-4300-acd5-9958089ff67e tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.793s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:04 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:19:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:19:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:19:10 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7602MB free_disk=25.032207489013672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:19:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance fd313577-5b50-48f3-b224-68542b958d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1528211a-3b92-46aa-8512-5c2568f361ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance f4db2f97-c674-4da7-91d8-ed10cf4c964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 89333c12-d47d-4480-a04f-bd502abf3829 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.658s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updating instance_info_cache with network_info: [{"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:19:12 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:19:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:19:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-4d452975-d932-4a5b-84da-b6923749c48d req-e2db3c63-70b2-4533-977a-316579237573 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received event network-changed-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-4d452975-d932-4a5b-84da-b6923749c48d req-e2db3c63-70b2-4533-977a-316579237573 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Refreshing instance network info cache due to event network-changed-ff3a0512-18ba-45c2-b1a4-7137ad1ac421. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4d452975-d932-4a5b-84da-b6923749c48d req-e2db3c63-70b2-4533-977a-316579237573 service nova] Acquiring lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4d452975-d932-4a5b-84da-b6923749c48d req-e2db3c63-70b2-4533-977a-316579237573 service nova] Acquired lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-4d452975-d932-4a5b-84da-b6923749c48d req-e2db3c63-70b2-4533-977a-316579237573 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Refreshing network info cache for port ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:26 user nova-compute[74963]: INFO nova.compute.manager [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Terminating instance
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-4d452975-d932-4a5b-84da-b6923749c48d req-e2db3c63-70b2-4533-977a-316579237573 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Updated VIF entry in instance network info cache for port ff3a0512-18ba-45c2-b1a4-7137ad1ac421. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-4d452975-d932-4a5b-84da-b6923749c48d req-e2db3c63-70b2-4533-977a-316579237573 service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Updating instance_info_cache with network_info: [{"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4d452975-d932-4a5b-84da-b6923749c48d req-e2db3c63-70b2-4533-977a-316579237573 service nova] Releasing lock "refresh_cache-f4db2f97-c674-4da7-91d8-ed10cf4c964a" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Instance destroyed successfully.
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.objects.instance [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'resources' on Instance uuid f4db2f97-c674-4da7-91d8-ed10cf4c964a {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1658909138',display_name='tempest-TestStampPattern-server-1658909138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1658909138',id=24,image_ref='4f3508e6-5f58-445c-adc0-78fbfdaf19b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXIfFHcf5hZJI1eOXWVSrzGJVOsClL3sRsQglOYWvzxqFcx/NwLGZqv1l34N2xD8aFbH1Lm1nfJS/HKaYuBZq5gxNl5qlH94PvOr+veB7phGIVgZOlhO4hSirM+QIZFUw==',key_name='tempest-TestStampPattern-1283092476',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:16:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fa068a8025245e0aa581bfad0b5c324',ramdisk_id='',reservation_id='r-4xvjtsma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fd313577-5b50-48f3-b224-68542b958d21',image_min_disk='1',image_min_ram='0',image_owner_id='9fa068a8025245e0aa581bfad0b5c324',image_owner_project_name='tempest-TestStampPattern-14898091',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-14898091-project-member',image_user_id='a0406077bdf143258a2d84290bb449da',owner_project_name='tempest-TestStampPattern-14898091',owner_user_name='tempest-TestStampPattern-14898091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:16:37Z,user_data=None,user_id='a0406077bdf143258a2d84290bb449da',uuid=f4db2f97-c674-4da7-91d8-ed10cf4c964a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converting VIF {"id": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "address": "fa:16:3e:92:be:4d", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3a0512-18", "ovs_interfaceid": "ff3a0512-18ba-45c2-b1a4-7137ad1ac421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:be:4d,bridge_name='br-int',has_traffic_filtering=True,id=ff3a0512-18ba-45c2-b1a4-7137ad1ac421,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3a0512-18') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG os_vif [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:be:4d,bridge_name='br-int',has_traffic_filtering=True,id=ff3a0512-18ba-45c2-b1a4-7137ad1ac421,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3a0512-18') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff3a0512-18, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30479f12-a063-4e92-a1d2-c83bcac249cb) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:19:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:26 user nova-compute[74963]: INFO os_vif [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:be:4d,bridge_name='br-int',has_traffic_filtering=True,id=ff3a0512-18ba-45c2-b1a4-7137ad1ac421,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3a0512-18')
Nov 30 08:19:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Deleting instance files /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a_del
Nov 30 08:19:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Deletion of /opt/stack/data/nova/instances/f4db2f97-c674-4da7-91d8-ed10cf4c964a_del complete
Nov 30 08:19:27 user nova-compute[74963]: INFO nova.compute.manager [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 30 08:19:27 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:19:27 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:19:27 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:19:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:27 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:19:27 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Took 0.48 seconds to deallocate network for instance.
Nov 30 08:19:27 user nova-compute[74963]: DEBUG nova.compute.manager [req-352fd4b2-31a2-4214-be51-dc7eb28452f1 req-c2fae796-4f77-463a-8058-dab8257c5d0c service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received event network-vif-deleted-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:27 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:19:27 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:28 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Deleted allocations for instance f4db2f97-c674-4da7-91d8-ed10cf4c964a
Nov 30 08:19:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53f07691-ecb5-4b4b-8fc1-0f4849802cdc tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received event network-vif-unplugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] No waiting events found dispatching network-vif-unplugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:19:28 user nova-compute[74963]: WARNING nova.compute.manager [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received unexpected event network-vif-unplugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 for instance with vm_state deleted and task_state None.
Nov 30 08:19:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received event network-vif-plugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] Acquiring lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] Lock "f4db2f97-c674-4da7-91d8-ed10cf4c964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] No waiting events found dispatching network-vif-plugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:19:28 user nova-compute[74963]: WARNING nova.compute.manager [req-917dd59a-f71c-457e-9dc0-b60a0d762afb req-d1047fdf-5795-45a4-876c-38aee8a5ce9b service nova] [instance: f4db2f97-c674-4da7-91d8-ed10cf4c964a] Received unexpected event network-vif-plugged-ff3a0512-18ba-45c2-b1a4-7137ad1ac421 for instance with vm_state deleted and task_state None.
Nov 30 08:19:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:30 user nova-compute[74963]: INFO nova.compute.manager [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Rescuing
Nov 30 08:19:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:19:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquired lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:19:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:19:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Updating instance_info_cache with network_info: [{"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:19:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Releasing lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:19:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG nova.compute.manager [req-ffbb16cd-b899-41b8-a795-43b5a92a8470 req-0807310d-2da9-49da-a509-bfe6769c88a6 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-unplugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffbb16cd-b899-41b8-a795-43b5a92a8470 req-0807310d-2da9-49da-a509-bfe6769c88a6 service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffbb16cd-b899-41b8-a795-43b5a92a8470 req-0807310d-2da9-49da-a509-bfe6769c88a6 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ffbb16cd-b899-41b8-a795-43b5a92a8470 req-0807310d-2da9-49da-a509-bfe6769c88a6 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG nova.compute.manager [req-ffbb16cd-b899-41b8-a795-43b5a92a8470 req-0807310d-2da9-49da-a509-bfe6769c88a6 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-unplugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:19:31 user nova-compute[74963]: WARNING nova.compute.manager [req-ffbb16cd-b899-41b8-a795-43b5a92a8470 req-0807310d-2da9-49da-a509-bfe6769c88a6 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-unplugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state active and task_state rescuing.
Nov 30 08:19:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:31 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Instance destroyed successfully.
Nov 30 08:19:31 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Attempting a stable device rescue
Nov 30 08:19:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74963) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Instance directory exists: not creating {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 08:19:31 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Creating image(s)
Nov 30 08:19:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "/opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "/opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "/opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG nova.objects.instance [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'trusted_certs' on Instance uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "2eefc96c9a5609d737394c49dd905668dbff440b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "2eefc96c9a5609d737394c49dd905668dbff440b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b.part --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:32 user nova-compute[74963]: DEBUG nova.virt.images [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] 6573a9b6-f8cb-4cfc-909e-41327c032be8 was qcow2, converting to raw {{(pid=74963) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 08:19:32 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:19:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b.part /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b.converted {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:32 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b.part /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b.converted" returned: 0 in 0.272s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b.converted --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-83ce254d-08e4-4d44-b8d1-fb0e06996970 req-2ed701c5-3b00-416b-9d88-d0c9612afb63 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-83ce254d-08e4-4d44-b8d1-fb0e06996970 req-2ed701c5-3b00-416b-9d88-d0c9612afb63 service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-83ce254d-08e4-4d44-b8d1-fb0e06996970 req-2ed701c5-3b00-416b-9d88-d0c9612afb63 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-83ce254d-08e4-4d44-b8d1-fb0e06996970 req-2ed701c5-3b00-416b-9d88-d0c9612afb63 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-83ce254d-08e4-4d44-b8d1-fb0e06996970 req-2ed701c5-3b00-416b-9d88-d0c9612afb63 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:19:33 user nova-compute[74963]: WARNING nova.compute.manager [req-83ce254d-08e4-4d44-b8d1-fb0e06996970 req-2ed701c5-3b00-416b-9d88-d0c9612afb63 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state active and task_state rescuing.
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "2eefc96c9a5609d737394c49dd905668dbff440b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.787s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "2eefc96c9a5609d737394c49dd905668dbff440b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "2eefc96c9a5609d737394c49dd905668dbff440b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b,backing_fmt=raw /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2eefc96c9a5609d737394c49dd905668dbff440b,backing_fmt=raw /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue" returned: 0 in 0.046s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "2eefc96c9a5609d737394c49dd905668dbff440b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.instance [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'migration_context' on Instance uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<38b0d9d9-9a05-44e3-bdd1-ac6da28204fe> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Start _get_guest_xml network_info=[{"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "vif_mac": "fa:16:3e:09:5d:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6573a9b6-f8cb-4cfc-909e-41327c032be8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJSQtNZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '38b0d9d9-9a05-44e3-bdd1-ac6da28204fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'e22766fe-5c2c-49af-86b6-ec8686d31eb4', 'serial': 'e22766fe-5c2c-49af-86b6-ec8686d31eb4'}, 'attachment_id': '18ec926a-dada-4e9f-bf9a-195f63118f91', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.instance [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'resources' on Instance uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<38b0d9d9-9a05-44e3-bdd1-ac6da28204fe> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.instance [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'numa_topology' on Instance uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<38b0d9d9-9a05-44e3-bdd1-ac6da28204fe> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:19:33 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:19:33 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.instance [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'vcpu_model' on Instance uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<38b0d9d9-9a05-44e3-bdd1-ac6da28204fe> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJSQtNZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:19:33 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:19:33 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:19:33 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc091d9-6478-4299-8e3b-75131c41e129]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wJSQtNZL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 08:19:33 user nova-compute[74963]: node.name = iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:19:33 user nova-compute[74963]: node.tpgt = -1
Nov 30 08:19:33 user nova-compute[74963]: node.startup = automatic
Nov 30 08:19:33 user nova-compute[74963]: node.leading_login = No
Nov 30 08:19:33 user nova-compute[74963]: iface.iscsi_ifacename = default
Nov 30 08:19:33 user nova-compute[74963]: iface.net_ifacename = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.ipaddress = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.prefix_len = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.hwaddress = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.transport_name = tcp
Nov 30 08:19:33 user nova-compute[74963]: iface.initiatorname = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.state = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.vlan_id = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.vlan_priority = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.vlan_state = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.iface_num = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.mtu = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.port = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.bootproto = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.subnet_mask = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.gateway = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.dhcp_alt_client_id = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.dhcp_dns = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.dhcp_learn_iqn = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.dhcp_vendor_id_state = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.dhcp_vendor_id = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.dhcp_slp_da = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.fragmentation = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.gratuitous_arp = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.incoming_forwarding = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.tos_state = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.tos = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.ttl = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.delayed_ack = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.tcp_nagle = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.tcp_wsf_state = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.tcp_wsf = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.tcp_timer_scale = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.tcp_timestamp = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.redirect = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.def_task_mgmt_timeout = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.header_digest = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.data_digest = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.immediate_data = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.initial_r2t = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.data_seq_inorder = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.data_pdu_inorder = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.erl = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.max_receive_data_len = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.first_burst_len = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.max_outstanding_r2t = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.max_burst_len = 0
Nov 30 08:19:33 user nova-compute[74963]: iface.chap_auth = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.bidi_chap = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.strict_login_compliance = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.discovery_auth = <empty>
Nov 30 08:19:33 user nova-compute[74963]: iface.discovery_logout = <empty>
Nov 30 08:19:33 user nova-compute[74963]: node.discovery_address = <empty>
Nov 30 08:19:33 user nova-compute[74963]: node.discovery_port = 0
Nov 30 08:19:33 user nova-compute[74963]: node.discovery_type = static
Nov 30 08:19:33 user nova-compute[74963]: node.session.initial_cmdsn = 0
Nov 30 08:19:33 user nova-compute[74963]: node.session.initial_login_retry_max = 8
Nov 30 08:19:33 user nova-compute[74963]: node.session.xmit_thread_priority = -20
Nov 30 08:19:33 user nova-compute[74963]: node.session.cmds_max = 128
Nov 30 08:19:33 user nova-compute[74963]: node.session.queue_depth = 32
Nov 30 08:19:33 user nova-compute[74963]: node.session.nr_sessions = 1
Nov 30 08:19:33 user nova-compute[74963]: node.session.auth.authmethod = CHAP
Nov 30 08:19:33 user nova-compute[74963]: node.session.auth.username = wJSQtNZL
Nov 30 08:19:33 user nova-compute[74963]: node.session.auth.password = ***
Nov 30 08:19:33 user nova-compute[74963]: node.session.auth.username_in = <empty>
Nov 30 08:19:33 user nova-compute[74963]: node.session.auth.password_in = <empty>
Nov 30 08:19:33 user nova-compute[74963]: node.session.auth.chap_algs = MD5
Nov 30 08:19:33 user nova-compute[74963]: node.session.timeo.replacement_timeout = 120
Nov 30 08:19:33 user nova-compute[74963]: node.session.err_timeo.abort_timeout = 15
Nov 30 08:19:33 user nova-compute[74963]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 08:19:33 user nova-compute[74963]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 08:19:33 user nova-compute[74963]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.FastAbort = Yes
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.InitialR2T = No
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.ImmediateData = Yes
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.MaxConnections = 1
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 08:19:33 user nova-compute[74963]: node.session.iscsi.ERL = 0
Nov 30 08:19:33 user nova-compute[74963]: node.session.scan = manual
Nov 30 08:19:33 user nova-compute[74963]: node.session.reopen_max = 0
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].address = 172.16.0.220
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].port = 3260
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].startup = manual
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].tcp.window_size = 524288
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].tcp.type_of_service = 0
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].timeo.logout_timeout = 15
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].timeo.login_timeout = 15
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].timeo.auth_timeout = 45
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].iscsi.DataDigest = None
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].iscsi.IFMarker = No
Nov 30 08:19:33 user nova-compute[74963]: node.conn[0].iscsi.OFMarker = No
Nov 30 08:19:33 user nova-compute[74963]: # END RECORD
Nov 30 08:19:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0a4d0f-12a7-4530-b4b3-5e59241b3aea]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaedb12-6d05-48e1-8371-eb12f8aac23b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJSQtNZL {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJSQtNZL" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[22df2a65-96cd-4baf-9d7a-3996a44b37c9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wJSQtNZL'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5da32f1-8c85-43e3-b7b4-205d9f1878b7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b67dd60-1e20-490d-817a-a2e5d6b36b06]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:19:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] HCTL ('34', '0', '0', 0) found on session 24 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ded4fa-8f06-40d5-97f0-f1c55be4abe9]: (4, ('0 0 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Searching for a device in session 24 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJSQtNZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.206s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] <== connect_volume: return (208ms) {'type': 'block', 'scsi_wwn': '23636663030633337', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636663030633337', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1543762884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1543762884',id=25,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-ksav8sxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:02Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=38b0d9d9-9a05-44e3-bdd1-ac6da28204fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "vif_mac": "fa:16:3e:09:5d:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "vif_mac": "fa:16:3e:09:5d:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=8bd435ad-5e5a-45c7-8282-3819f0935b25,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd435ad-5e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.instance [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'pci_devices' on Instance uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.objects.base [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Object Instance<38b0d9d9-9a05-44e3-bdd1-ac6da28204fe> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:19:33 user nova-compute[74963]:   <uuid>38b0d9d9-9a05-44e3-bdd1-ac6da28204fe</uuid>
Nov 30 08:19:33 user nova-compute[74963]:   <name>instance-00000019</name>
Nov 30 08:19:33 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:19:33 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:19:33 user nova-compute[74963]:   <metadata>
Nov 30 08:19:33 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:19:33 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:19:33 user nova-compute[74963]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1543762884</nova:name>
Nov 30 08:19:33 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:19:33</nova:creationTime>
Nov 30 08:19:33 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:19:33 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:19:33 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:19:33 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:19:33 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:19:33 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:19:33 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:19:33 user nova-compute[74963]:       <nova:owner>
Nov 30 08:19:33 user nova-compute[74963]:         <nova:user uuid="4b110fcb508342509690b45e1854eb81">tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member</nova:user>
Nov 30 08:19:33 user nova-compute[74963]:         <nova:project uuid="ce233bd757b64de4bd6f6abb3230da01">tempest-ServerBootFromVolumeStableRescueTest-1834985655</nova:project>
Nov 30 08:19:33 user nova-compute[74963]:       </nova:owner>
Nov 30 08:19:33 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:19:33 user nova-compute[74963]:       <nova:ports>
Nov 30 08:19:33 user nova-compute[74963]:         <nova:port uuid="8bd435ad-5e5a-45c7-8282-3819f0935b25">
Nov 30 08:19:33 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 08:19:33 user nova-compute[74963]:         </nova:port>
Nov 30 08:19:33 user nova-compute[74963]:       </nova:ports>
Nov 30 08:19:33 user nova-compute[74963]:     </nova:instance>
Nov 30 08:19:33 user nova-compute[74963]:   </metadata>
Nov 30 08:19:33 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:19:33 user nova-compute[74963]:     <system>
Nov 30 08:19:33 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:19:33 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:19:33 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:19:33 user nova-compute[74963]:       <entry name="serial">38b0d9d9-9a05-44e3-bdd1-ac6da28204fe</entry>
Nov 30 08:19:33 user nova-compute[74963]:       <entry name="uuid">38b0d9d9-9a05-44e3-bdd1-ac6da28204fe</entry>
Nov 30 08:19:33 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:19:33 user nova-compute[74963]:     </system>
Nov 30 08:19:33 user nova-compute[74963]:   </sysinfo>
Nov 30 08:19:33 user nova-compute[74963]:   <os>
Nov 30 08:19:33 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:19:33 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:19:33 user nova-compute[74963]:   </os>
Nov 30 08:19:33 user nova-compute[74963]:   <features>
Nov 30 08:19:33 user nova-compute[74963]:     <acpi/>
Nov 30 08:19:33 user nova-compute[74963]:     <apic/>
Nov 30 08:19:33 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:19:33 user nova-compute[74963]:   </features>
Nov 30 08:19:33 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:19:33 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:19:33 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:19:33 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:19:33 user nova-compute[74963]:   </clock>
Nov 30 08:19:33 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:19:33 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:19:33 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:19:33 user nova-compute[74963]:   </cpu>
Nov 30 08:19:33 user nova-compute[74963]:   <devices>
Nov 30 08:19:33 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:19:33 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:19:33 user nova-compute[74963]:       <source dev="/dev/sdc"/>
Nov 30 08:19:33 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:19:33 user nova-compute[74963]:       <serial>e22766fe-5c2c-49af-86b6-ec8686d31eb4</serial>
Nov 30 08:19:33 user nova-compute[74963]:     </disk>
Nov 30 08:19:33 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:19:33 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:19:33 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue"/>
Nov 30 08:19:33 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:19:33 user nova-compute[74963]:       <boot order="1"/>
Nov 30 08:19:33 user nova-compute[74963]:     </disk>
Nov 30 08:19:33 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:19:33 user nova-compute[74963]:       <mac address="fa:16:3e:09:5d:bb"/>
Nov 30 08:19:33 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:19:33 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:19:33 user nova-compute[74963]:       <target dev="tap8bd435ad-5e"/>
Nov 30 08:19:33 user nova-compute[74963]:     </interface>
Nov 30 08:19:33 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:19:33 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/console.log" append="off"/>
Nov 30 08:19:33 user nova-compute[74963]:     </serial>
Nov 30 08:19:33 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:19:33 user nova-compute[74963]:     <video>
Nov 30 08:19:33 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:19:33 user nova-compute[74963]:     </video>
Nov 30 08:19:33 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:19:33 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:19:33 user nova-compute[74963]:     </rng>
Nov 30 08:19:33 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:19:33 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:19:33 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:19:33 user nova-compute[74963]:     </memballoon>
Nov 30 08:19:33 user nova-compute[74963]:   </devices>
Nov 30 08:19:33 user nova-compute[74963]: </domain>
Nov 30 08:19:33 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:19:33 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Instance destroyed successfully.
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:19:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] No VIF found with MAC fa:16:3e:09:5d:bb, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:19:34 user nova-compute[74963]: INFO nova.compute.claims [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Claim successful on node user
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.network.neutron [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:19:34 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.policy [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b068a21b7ee04d14984abc97e582aa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d09678c8a049bca20bed732eedd231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:19:34 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Creating image(s)
Nov 30 08:19:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:34 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-f372d6c4-67c2-4043-84d8-dd58ab96e108 req-bae20f44-a85e-4ed3-b04b-2c2c4807ace7 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f372d6c4-67c2-4043-84d8-dd58ab96e108 req-bae20f44-a85e-4ed3-b04b-2c2c4807ace7 service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f372d6c4-67c2-4043-84d8-dd58ab96e108 req-bae20f44-a85e-4ed3-b04b-2c2c4807ace7 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f372d6c4-67c2-4043-84d8-dd58ab96e108 req-bae20f44-a85e-4ed3-b04b-2c2c4807ace7 service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-f372d6c4-67c2-4043-84d8-dd58ab96e108 req-bae20f44-a85e-4ed3-b04b-2c2c4807ace7 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:19:35 user nova-compute[74963]: WARNING nova.compute.manager [req-f372d6c4-67c2-4043-84d8-dd58ab96e108 req-bae20f44-a85e-4ed3-b04b-2c2c4807ace7 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state active and task_state rescuing.
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk 1073741824" returned: 0 in 0.056s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG nova.network.neutron [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Successfully created port: 954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Cannot resize image /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Ensure instance console log exists: /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.network.neutron [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Successfully updated port: 954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquired lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.network.neutron [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.compute.manager [req-a9d5f6fe-a47d-4acc-8828-cc0c22c14ad2 req-4d3d464d-6456-46c4-b432-3974578bd1dd service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-changed-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.compute.manager [req-a9d5f6fe-a47d-4acc-8828-cc0c22c14ad2 req-4d3d464d-6456-46c4-b432-3974578bd1dd service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Refreshing instance network info cache due to event network-changed-954e13fe-66db-4b7f-9ff1-ad70f956e95f. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a9d5f6fe-a47d-4acc-8828-cc0c22c14ad2 req-4d3d464d-6456-46c4-b432-3974578bd1dd service nova] Acquiring lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.network.neutron [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.network.neutron [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updating instance_info_cache with network_info: [{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Releasing lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Instance network_info: |[{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a9d5f6fe-a47d-4acc-8828-cc0c22c14ad2 req-4d3d464d-6456-46c4-b432-3974578bd1dd service nova] Acquired lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.network.neutron [req-a9d5f6fe-a47d-4acc-8828-cc0c22c14ad2 req-4d3d464d-6456-46c4-b432-3974578bd1dd service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Refreshing network info cache for port 954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Start _get_guest_xml network_info=[{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:19:36 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:19:36 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1792156780',display_name='tempest-ServerRescueNegativeTestJSON-server-1792156780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1792156780',id=27,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw45HBZ5xU19gc9vrUU/5CeRU2AmyOb8wCG3xs4Xu+gBPBjAO9Y32a7/m95UeqCYXma7Nc/crom/3bi0PJ9GohtwPeZABzy2+eRhQoizkFvRsYJkg+rOrhXUUklTA5pSQ==',key_name='tempest-keypair-330175841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-bcymuq0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b068a21b7ee04d14984abc97e582aa63',uuid=09f16ba8-8601-4fbf-a87a-fd84525f99ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7e:2f,bridge_name='br-int',has_traffic_filtering=True,id=954e13fe-66db-4b7f-9ff1-ad70f956e95f,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap954e13fe-66') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.objects.instance [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'pci_devices' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:19:36 user nova-compute[74963]:   <uuid>09f16ba8-8601-4fbf-a87a-fd84525f99ca</uuid>
Nov 30 08:19:36 user nova-compute[74963]:   <name>instance-0000001b</name>
Nov 30 08:19:36 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:19:36 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:19:36 user nova-compute[74963]:   <metadata>
Nov 30 08:19:36 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:19:36 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:19:36 user nova-compute[74963]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1792156780</nova:name>
Nov 30 08:19:36 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:19:36</nova:creationTime>
Nov 30 08:19:36 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:19:36 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:19:36 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:19:36 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:19:36 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:19:36 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:19:36 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:19:36 user nova-compute[74963]:       <nova:owner>
Nov 30 08:19:36 user nova-compute[74963]:         <nova:user uuid="b068a21b7ee04d14984abc97e582aa63">tempest-ServerRescueNegativeTestJSON-1047810333-project-member</nova:user>
Nov 30 08:19:36 user nova-compute[74963]:         <nova:project uuid="c1d09678c8a049bca20bed732eedd231">tempest-ServerRescueNegativeTestJSON-1047810333</nova:project>
Nov 30 08:19:36 user nova-compute[74963]:       </nova:owner>
Nov 30 08:19:36 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:19:36 user nova-compute[74963]:       <nova:ports>
Nov 30 08:19:36 user nova-compute[74963]:         <nova:port uuid="954e13fe-66db-4b7f-9ff1-ad70f956e95f">
Nov 30 08:19:36 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:19:36 user nova-compute[74963]:         </nova:port>
Nov 30 08:19:36 user nova-compute[74963]:       </nova:ports>
Nov 30 08:19:36 user nova-compute[74963]:     </nova:instance>
Nov 30 08:19:36 user nova-compute[74963]:   </metadata>
Nov 30 08:19:36 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:19:36 user nova-compute[74963]:     <system>
Nov 30 08:19:36 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:19:36 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:19:36 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:19:36 user nova-compute[74963]:       <entry name="serial">09f16ba8-8601-4fbf-a87a-fd84525f99ca</entry>
Nov 30 08:19:36 user nova-compute[74963]:       <entry name="uuid">09f16ba8-8601-4fbf-a87a-fd84525f99ca</entry>
Nov 30 08:19:36 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:19:36 user nova-compute[74963]:     </system>
Nov 30 08:19:36 user nova-compute[74963]:   </sysinfo>
Nov 30 08:19:36 user nova-compute[74963]:   <os>
Nov 30 08:19:36 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:19:36 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:19:36 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:19:36 user nova-compute[74963]:   </os>
Nov 30 08:19:36 user nova-compute[74963]:   <features>
Nov 30 08:19:36 user nova-compute[74963]:     <acpi/>
Nov 30 08:19:36 user nova-compute[74963]:     <apic/>
Nov 30 08:19:36 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:19:36 user nova-compute[74963]:   </features>
Nov 30 08:19:36 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:19:36 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:19:36 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:19:36 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:19:36 user nova-compute[74963]:   </clock>
Nov 30 08:19:36 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:19:36 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:19:36 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:19:36 user nova-compute[74963]:   </cpu>
Nov 30 08:19:36 user nova-compute[74963]:   <devices>
Nov 30 08:19:36 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:19:36 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:19:36 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk"/>
Nov 30 08:19:36 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:19:36 user nova-compute[74963]:     </disk>
Nov 30 08:19:36 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:19:36 user nova-compute[74963]:       <mac address="fa:16:3e:7b:7e:2f"/>
Nov 30 08:19:36 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:19:36 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:19:36 user nova-compute[74963]:       <target dev="tap954e13fe-66"/>
Nov 30 08:19:36 user nova-compute[74963]:     </interface>
Nov 30 08:19:36 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:19:36 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/console.log" append="off"/>
Nov 30 08:19:36 user nova-compute[74963]:     </serial>
Nov 30 08:19:36 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:19:36 user nova-compute[74963]:     <video>
Nov 30 08:19:36 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:19:36 user nova-compute[74963]:     </video>
Nov 30 08:19:36 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:19:36 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:19:36 user nova-compute[74963]:     </rng>
Nov 30 08:19:36 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:19:36 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:19:36 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:19:36 user nova-compute[74963]:     </memballoon>
Nov 30 08:19:36 user nova-compute[74963]:   </devices>
Nov 30 08:19:36 user nova-compute[74963]: </domain>
Nov 30 08:19:36 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1792156780',display_name='tempest-ServerRescueNegativeTestJSON-server-1792156780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1792156780',id=27,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw45HBZ5xU19gc9vrUU/5CeRU2AmyOb8wCG3xs4Xu+gBPBjAO9Y32a7/m95UeqCYXma7Nc/crom/3bi0PJ9GohtwPeZABzy2+eRhQoizkFvRsYJkg+rOrhXUUklTA5pSQ==',key_name='tempest-keypair-330175841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-bcymuq0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b068a21b7ee04d14984abc97e582aa63',uuid=09f16ba8-8601-4fbf-a87a-fd84525f99ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7e:2f,bridge_name='br-int',has_traffic_filtering=True,id=954e13fe-66db-4b7f-9ff1-ad70f956e95f,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap954e13fe-66') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG os_vif [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7e:2f,bridge_name='br-int',has_traffic_filtering=True,id=954e13fe-66db-4b7f-9ff1-ad70f956e95f,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap954e13fe-66') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '921758ec-4b77-5a03-b0e0-aec651cc7195', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap954e13fe-66, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap954e13fe-66, col_values=(('qos', UUID('38fd6edc-0f96-4794-a6d5-b9be5be5a3e5')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap954e13fe-66, col_values=(('external_ids', {'iface-id': '954e13fe-66db-4b7f-9ff1-ad70f956e95f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:7e:2f', 'vm-uuid': '09f16ba8-8601-4fbf-a87a-fd84525f99ca'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:36 user nova-compute[74963]: INFO os_vif [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7e:2f,bridge_name='br-int',has_traffic_filtering=True,id=954e13fe-66db-4b7f-9ff1-ad70f956e95f,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap954e13fe-66')
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:19:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No VIF found with MAC fa:16:3e:7b:7e:2f, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:19:37 user nova-compute[74963]: DEBUG nova.network.neutron [req-a9d5f6fe-a47d-4acc-8828-cc0c22c14ad2 req-4d3d464d-6456-46c4-b432-3974578bd1dd service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updated VIF entry in instance network info cache for port 954e13fe-66db-4b7f-9ff1-ad70f956e95f. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:19:37 user nova-compute[74963]: DEBUG nova.network.neutron [req-a9d5f6fe-a47d-4acc-8828-cc0c22c14ad2 req-4d3d464d-6456-46c4-b432-3974578bd1dd service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updating instance_info_cache with network_info: [{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:19:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a9d5f6fe-a47d-4acc-8828-cc0c22c14ad2 req-4d3d464d-6456-46c4-b432-3974578bd1dd service nova] Releasing lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:19:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-efa14e60-a9b9-4056-bc53-a78c9fb81928 req-a4c8f7e5-542f-4d6f-9cec-0cdd163b433f service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-efa14e60-a9b9-4056-bc53-a78c9fb81928 req-a4c8f7e5-542f-4d6f-9cec-0cdd163b433f service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-efa14e60-a9b9-4056-bc53-a78c9fb81928 req-a4c8f7e5-542f-4d6f-9cec-0cdd163b433f service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-efa14e60-a9b9-4056-bc53-a78c9fb81928 req-a4c8f7e5-542f-4d6f-9cec-0cdd163b433f service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:37 user nova-compute[74963]: DEBUG nova.compute.manager [req-efa14e60-a9b9-4056-bc53-a78c9fb81928 req-a4c8f7e5-542f-4d6f-9cec-0cdd163b433f service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:19:37 user nova-compute[74963]: WARNING nova.compute.manager [req-efa14e60-a9b9-4056-bc53-a78c9fb81928 req-a4c8f7e5-542f-4d6f-9cec-0cdd163b433f service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state active and task_state rescuing.
Nov 30 08:19:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-df9a48ee-0d6b-4ef7-b897-dc5eb8847c17 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-0726ffff-6b53-4a8e-a48b-bba5cf247e13 req-1008d700-3125-49e0-8dea-cdf3e1b3edb0 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0726ffff-6b53-4a8e-a48b-bba5cf247e13 req-1008d700-3125-49e0-8dea-cdf3e1b3edb0 service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0726ffff-6b53-4a8e-a48b-bba5cf247e13 req-1008d700-3125-49e0-8dea-cdf3e1b3edb0 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0726ffff-6b53-4a8e-a48b-bba5cf247e13 req-1008d700-3125-49e0-8dea-cdf3e1b3edb0 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-0726ffff-6b53-4a8e-a48b-bba5cf247e13 req-1008d700-3125-49e0-8dea-cdf3e1b3edb0 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:19:38 user nova-compute[74963]: WARNING nova.compute.manager [req-0726ffff-6b53-4a8e-a48b-bba5cf247e13 req-1008d700-3125-49e0-8dea-cdf3e1b3edb0 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state building and task_state spawning.
Nov 30 08:19:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:19:40 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Instance spawned successfully.
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-1bbe4543-260e-4f50-a4f1-604c9e3e63c3 req-1d489d6e-d11b-4e67-9ae2-030d1e8d02be service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1bbe4543-260e-4f50-a4f1-604c9e3e63c3 req-1d489d6e-d11b-4e67-9ae2-030d1e8d02be service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1bbe4543-260e-4f50-a4f1-604c9e3e63c3 req-1d489d6e-d11b-4e67-9ae2-030d1e8d02be service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1bbe4543-260e-4f50-a4f1-604c9e3e63c3 req-1d489d6e-d11b-4e67-9ae2-030d1e8d02be service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-1bbe4543-260e-4f50-a4f1-604c9e3e63c3 req-1d489d6e-d11b-4e67-9ae2-030d1e8d02be service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:19:40 user nova-compute[74963]: WARNING nova.compute.manager [req-1bbe4543-260e-4f50-a4f1-604c9e3e63c3 req-1d489d6e-d11b-4e67-9ae2-030d1e8d02be service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state building and task_state spawning.
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:19:40 user nova-compute[74963]: INFO nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 30 08:19:40 user nova-compute[74963]: DEBUG nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:19:40 user nova-compute[74963]: INFO nova.compute.manager [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Took 6.50 seconds to build instance.
Nov 30 08:19:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-17a3ab0c-4ab1-4e5e-be96-60da806ec2ea tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.591s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.007s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:51 user nova-compute[74963]: DEBUG nova.objects.instance [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'flavor' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:19:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:52 user nova-compute[74963]: INFO nova.compute.manager [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Attaching volume de544a0f-7e9e-41f7-8706-c2402010a750 to /dev/vdb
Nov 30 08:19:52 user nova-compute[74963]: DEBUG os_brick.utils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9510d5b2-8016-4211-b24d-4252bfff7eba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e0a361-11c8-4d9b-b9b3-c4f4b1c941f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa98557-8181-471e-9fa5-7689081d10e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f58aa6b-d50d-49c3-bdbc-25cea5a977da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:19:52 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:19:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa127f69-285d-4e09-97be-e8b6806db45c]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG os_brick.utils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:19:52 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating existing volume attachment record: 9550d3e8-5b85-4fa1-bf63-e2670c1d68d9 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:19:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:19:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:19:53 user nova-compute[74963]: INFO nova.compute.manager [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Detaching volume 53b76d17-133b-4587-b9b0-8dc8ea688bff
Nov 30 08:19:53 user nova-compute[74963]: INFO nova.virt.block_device [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Attempting to driver detach volume 53b76d17-133b-4587-b9b0-8dc8ea688bff from mountpoint /dev/vdb
Nov 30 08:19:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Attempting to detach device vdb from instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:19:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:19:53 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:19:53 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:19:53 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:19:53 user nova-compute[74963]:   <serial>53b76d17-133b-4587-b9b0-8dc8ea688bff</serial>
Nov 30 08:19:53 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 08:19:53 user nova-compute[74963]: </disk>
Nov 30 08:19:53 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:19:53 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully detached device vdb from instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 from the persistent domain config.
Nov 30 08:19:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:19:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:19:53 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:19:53 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:19:53 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:19:53 user nova-compute[74963]:   <serial>53b76d17-133b-4587-b9b0-8dc8ea688bff</serial>
Nov 30 08:19:53 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 08:19:53 user nova-compute[74963]: </disk>
Nov 30 08:19:53 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:19:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:19:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:19:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:20:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquired lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:20:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:20:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'info_cache' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:00 user nova-compute[74963]: DEBUG nova.objects.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.network.neutron [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updating instance_info_cache with network_info: [{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Releasing lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:20:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance destroyed successfully.
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'resources' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.objects.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-947669859',display_name='tempest-AttachVolumeTestJSON-server-947669859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-947669859',id=22,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB89fVSzhtfwm1Lv4FTMQ2ggrdWdEmZEvTquBWG5boPgjeuHpCpNY7WcHKpOKqoOmBzQZB62F68xan1ZQtOg94hSbmIl0OyitqdcaGNNsJ2QLVnxkTze3FfA/yhI2bNjhg==',key_name='tempest-keypair-1328476592',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-ls2r7c4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:18:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=ddde2d1c-aa4e-4415-ab80-6c5e217aae37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_vif [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf90eb0e-d1, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f6d9693-6387-436d-b352-86fc09eda026) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:01 user nova-compute[74963]: INFO os_vif [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1')
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUanhIZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:20:01 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae82042a-acfa-4579-9ab2-8e1f52d119d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:20:01 user nova-compute[74963]: No targets found.
Nov 30 08:20:01 user nova-compute[74963]: iSNS:
Nov 30 08:20:01 user nova-compute[74963]: No targets found.
Nov 30 08:20:01 user nova-compute[74963]: STATIC:
Nov 30 08:20:01 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:20:01 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:01 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:01 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff
Nov 30 08:20:01 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:01 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:01 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879
Nov 30 08:20:01 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:01 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:01 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851
Nov 30 08:20:01 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:01 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:01 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771
Nov 30 08:20:01 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:01 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:01 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4
Nov 30 08:20:01 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:01 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:01 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:20:01 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:01 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:01 user nova-compute[74963]: FIRMWARE:
Nov 30 08:20:01 user nova-compute[74963]: No targets found.
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:20:01 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:20:01 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e4c567-9f46-46af-8dfe-110a746fd8dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbnTeIkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:20:01 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd7c9e9-6adc-4480-b393-27d9134dd577]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6220757b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771'): ({'sde'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Removing single pathed devices sde {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2604a7d-7bde-42f3-960b-36e81cf87ca3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e518c23b-8b9e-4c9c-8c01-c546a4e91f16]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flushing IO for device /dev/sde {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1394fbf-faaa-48cf-9e7b-b4aaa1559f5f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d805fe-7190-4e17-88e2-329aa4dbb479]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6575b06f-adc1-4074-a894-8270dbf9947c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d57bef-5aac-4956-ba58-f9bd8d917ae5]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260]
Nov 30 08:20:01 user nova-compute[74963]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260] successful.
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7327e5d7-d8eb-4847-84c3-d08152690b96]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== disconnect_volume: return (344ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.264s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:01 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:01 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Start _get_guest_xml network_info=[{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUanhIZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ddde2d1c-aa4e-4415-ab80-6c5e217aae37', 'attached_at': '', 'detached_at': '', 'volume_id': '65d1e2f3-3675-4fcd-9bf5-771135fca771', 'serial': '65d1e2f3-3675-4fcd-9bf5-771135fca771'}, 'attachment_id': 'b6b81ea5-ce18-42d3-a68e-ddc0e7fa4960', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'numa_topology' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baa0e40-a586-4495-8869-105b8fa62c80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:20:01 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.objects.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:20:01 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'vcpu_model' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e104ee-60e3-4a3a-ba8d-9e37b4193480]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750] added
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.objects.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUanhIZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:20:01 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[924044f9-5771-4ce9-9008-7283a5580e35]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4df4ff-e502-4b71-999d-d2527ab8c191]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbnTeIkf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbnTeIkf" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ef7604-3353-4e74-a136-ecc945820f71]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pbnTeIkf'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[53842599-bc30-45f8-8766-73430d209ea7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[94609b9b-f9d1-47aa-b355-c0e441464ecb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c4a585-3f28-4a08-bad7-31254ed04d41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750, portal: 172.16.0.220,3260]
Nov 30 08:20:01 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750, portal: 172.16.0.220,3260] successful.
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8aa9fe-cb73-4902-a0da-e6da41471126]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[148b19b9-5297-4cd7-b640-1ab12372b4be]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:01 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad632b6-177b-46e2-84d7-594fcc12f355]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:01 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbnTeIkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] <== connect_volume: return (1623ms) {'type': 'block', 'scsi_wwn': '26463313061313130', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313061313130', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.272s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:02 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:02 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG nova.objects.instance [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'flavor' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f07589-2b19-4a3c-9841-ddbad151192b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:20:02 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:20:02 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:20:02 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:20:02 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:20:02 user nova-compute[74963]:   <serial>de544a0f-7e9e-41f7-8706-c2402010a750</serial>
Nov 30 08:20:02 user nova-compute[74963]: </disk>
Nov 30 08:20:02 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa48857-becb-421a-9ad6-7bd6e9c970bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771] added
Nov 30 08:20:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11df52b-da94-4f1e-97a4-f85e62b0d537]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97e5e87-9138-4848-8211-725fa73f8cd2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUanhIZx {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUanhIZx" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb533032-9904-4436-b96a-b9d02048ac95]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUanhIZx'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4792c051-d633-49c4-9d10-ce19ade5141f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52eb113-3d7c-4db0-822f-c302c8e3d3ce]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[846e1152-6ff8-496d-8d53-dc4997a7204d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260]
Nov 30 08:20:03 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260] successful.
Nov 30 08:20:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4d2f68-ea4c-450c-aef7-3a321de5350b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[683af3ff-45c3-4f99-ab40-f256dda8e521]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d818890c-5d7f-43f7-b39c-bb80e9e1adb8]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUanhIZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] No VIF found with MAC fa:16:3e:ed:d5:1c, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-548698c3-4f6d-4674-9a97-beb75a0345e4 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.426s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-5c79545c-d6e2-415a-93d8-e719bc8edea0 req-a0702746-b8f0-4cd6-b646-669a1f4355a2 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-changed-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-5c79545c-d6e2-415a-93d8-e719bc8edea0 req-a0702746-b8f0-4cd6-b646-669a1f4355a2 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing instance network info cache due to event network-changed-20953d60-33c1-4fc6-a18c-348e973adf58. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5c79545c-d6e2-415a-93d8-e719bc8edea0 req-a0702746-b8f0-4cd6-b646-669a1f4355a2 service nova] Acquiring lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5c79545c-d6e2-415a-93d8-e719bc8edea0 req-a0702746-b8f0-4cd6-b646-669a1f4355a2 service nova] Acquired lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:20:03 user nova-compute[74963]: DEBUG nova.network.neutron [req-5c79545c-d6e2-415a-93d8-e719bc8edea0 req-a0702746-b8f0-4cd6-b646-669a1f4355a2 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Refreshing network info cache for port 20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:04 user nova-compute[74963]: INFO nova.compute.manager [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Rescuing
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquired lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.network.neutron [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-5c79545c-d6e2-415a-93d8-e719bc8edea0 req-a0702746-b8f0-4cd6-b646-669a1f4355a2 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updated VIF entry in instance network info cache for port 20953d60-33c1-4fc6-a18c-348e973adf58. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-5c79545c-d6e2-415a-93d8-e719bc8edea0 req-a0702746-b8f0-4cd6-b646-669a1f4355a2 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [{"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5c79545c-d6e2-415a-93d8-e719bc8edea0 req-a0702746-b8f0-4cd6-b646-669a1f4355a2 service nova] Releasing lock "refresh_cache-89333c12-d47d-4480-a04f-bd502abf3829" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== connect_volume: return (2635ms) {'type': 'block', 'scsi_wwn': '26336323032643065', 'path': '/dev/sdf'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336323032643065', 'path': '/dev/sdf'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-947669859',display_name='tempest-AttachVolumeTestJSON-server-947669859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-947669859',id=22,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB89fVSzhtfwm1Lv4FTMQ2ggrdWdEmZEvTquBWG5boPgjeuHpCpNY7WcHKpOKqoOmBzQZB62F68xan1ZQtOg94hSbmIl0OyitqdcaGNNsJ2QLVnxkTze3FfA/yhI2bNjhg==',key_name='tempest-keypair-1328476592',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-ls2r7c4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:18:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=ddde2d1c-aa4e-4415-ab80-6c5e217aae37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'pci_devices' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.objects.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:20:04 user nova-compute[74963]:   <uuid>ddde2d1c-aa4e-4415-ab80-6c5e217aae37</uuid>
Nov 30 08:20:04 user nova-compute[74963]:   <name>instance-00000016</name>
Nov 30 08:20:04 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:20:04 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:20:04 user nova-compute[74963]:   <metadata>
Nov 30 08:20:04 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:20:04 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:20:04 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeTestJSON-server-947669859</nova:name>
Nov 30 08:20:04 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:20:01</nova:creationTime>
Nov 30 08:20:04 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:20:04 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:20:04 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:20:04 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:20:04 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:20:04 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:20:04 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:20:04 user nova-compute[74963]:       <nova:owner>
Nov 30 08:20:04 user nova-compute[74963]:         <nova:user uuid="5faaefd1e3d946eba7123229378d79fe">tempest-AttachVolumeTestJSON-1519701713-project-member</nova:user>
Nov 30 08:20:04 user nova-compute[74963]:         <nova:project uuid="df8be2ffbe2e411590d35d9c12196ba8">tempest-AttachVolumeTestJSON-1519701713</nova:project>
Nov 30 08:20:04 user nova-compute[74963]:       </nova:owner>
Nov 30 08:20:04 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:20:04 user nova-compute[74963]:       <nova:ports>
Nov 30 08:20:04 user nova-compute[74963]:         <nova:port uuid="af90eb0e-d1c3-4629-9d1a-1c224e637b11">
Nov 30 08:20:04 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 08:20:04 user nova-compute[74963]:         </nova:port>
Nov 30 08:20:04 user nova-compute[74963]:       </nova:ports>
Nov 30 08:20:04 user nova-compute[74963]:     </nova:instance>
Nov 30 08:20:04 user nova-compute[74963]:   </metadata>
Nov 30 08:20:04 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:20:04 user nova-compute[74963]:     <system>
Nov 30 08:20:04 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:20:04 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:20:04 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:20:04 user nova-compute[74963]:       <entry name="serial">ddde2d1c-aa4e-4415-ab80-6c5e217aae37</entry>
Nov 30 08:20:04 user nova-compute[74963]:       <entry name="uuid">ddde2d1c-aa4e-4415-ab80-6c5e217aae37</entry>
Nov 30 08:20:04 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:20:04 user nova-compute[74963]:     </system>
Nov 30 08:20:04 user nova-compute[74963]:   </sysinfo>
Nov 30 08:20:04 user nova-compute[74963]:   <os>
Nov 30 08:20:04 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:20:04 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:20:04 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:20:04 user nova-compute[74963]:   </os>
Nov 30 08:20:04 user nova-compute[74963]:   <features>
Nov 30 08:20:04 user nova-compute[74963]:     <acpi/>
Nov 30 08:20:04 user nova-compute[74963]:     <apic/>
Nov 30 08:20:04 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:20:04 user nova-compute[74963]:   </features>
Nov 30 08:20:04 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:20:04 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:20:04 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:20:04 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:20:04 user nova-compute[74963]:   </clock>
Nov 30 08:20:04 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:20:04 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:20:04 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:20:04 user nova-compute[74963]:   </cpu>
Nov 30 08:20:04 user nova-compute[74963]:   <devices>
Nov 30 08:20:04 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:20:04 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:20:04 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk"/>
Nov 30 08:20:04 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:20:04 user nova-compute[74963]:     </disk>
Nov 30 08:20:04 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:20:04 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:20:04 user nova-compute[74963]:       <source dev="/dev/sdf"/>
Nov 30 08:20:04 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:20:04 user nova-compute[74963]:       <serial>65d1e2f3-3675-4fcd-9bf5-771135fca771</serial>
Nov 30 08:20:04 user nova-compute[74963]:     </disk>
Nov 30 08:20:04 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:20:04 user nova-compute[74963]:       <mac address="fa:16:3e:c2:ee:25"/>
Nov 30 08:20:04 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:20:04 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:20:04 user nova-compute[74963]:       <target dev="tapaf90eb0e-d1"/>
Nov 30 08:20:04 user nova-compute[74963]:     </interface>
Nov 30 08:20:04 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:20:04 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/console.log" append="off"/>
Nov 30 08:20:04 user nova-compute[74963]:     </serial>
Nov 30 08:20:04 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:20:04 user nova-compute[74963]:     <video>
Nov 30 08:20:04 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:20:04 user nova-compute[74963]:     </video>
Nov 30 08:20:04 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:20:04 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:20:04 user nova-compute[74963]:     </rng>
Nov 30 08:20:04 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:20:04 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:20:04 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:20:04 user nova-compute[74963]:     </memballoon>
Nov 30 08:20:04 user nova-compute[74963]:   </devices>
Nov 30 08:20:04 user nova-compute[74963]: </domain>
Nov 30 08:20:04 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'trusted_certs' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.objects.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.network.neutron [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating instance_info_cache with network_info: [{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Releasing lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:20:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Cannot resize image /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'migration_context' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG nova.objects.base [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-947669859',display_name='tempest-AttachVolumeTestJSON-server-947669859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-947669859',id=22,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB89fVSzhtfwm1Lv4FTMQ2ggrdWdEmZEvTquBWG5boPgjeuHpCpNY7WcHKpOKqoOmBzQZB62F68xan1ZQtOg94hSbmIl0OyitqdcaGNNsJ2QLVnxkTze3FfA/yhI2bNjhg==',key_name='tempest-keypair-1328476592',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-ls2r7c4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=ddde2d1c-aa4e-4415-ab80-6c5e217aae37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG os_vif [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '953b5a5c-8a12-557b-b081-a3cce09a10e5', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf90eb0e-d1, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf90eb0e-d1, col_values=(('qos', UUID('87aeb9a9-715d-42d3-8eb3-86cec16f3bdb')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf90eb0e-d1, col_values=(('external_ids', {'iface-id': 'af90eb0e-d1c3-4629-9d1a-1c224e637b11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:ee:25', 'vm-uuid': 'ddde2d1c-aa4e-4415-ab80-6c5e217aae37'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:05 user nova-compute[74963]: INFO os_vif [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1')
Nov 30 08:20:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-10592f49-52f9-40ef-b060-c37d1aed1515 req-9907c2d0-f1b8-4f0a-9476-9752400f8a25 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-unplugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-10592f49-52f9-40ef-b060-c37d1aed1515 req-9907c2d0-f1b8-4f0a-9476-9752400f8a25 service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-10592f49-52f9-40ef-b060-c37d1aed1515 req-9907c2d0-f1b8-4f0a-9476-9752400f8a25 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-10592f49-52f9-40ef-b060-c37d1aed1515 req-9907c2d0-f1b8-4f0a-9476-9752400f8a25 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-10592f49-52f9-40ef-b060-c37d1aed1515 req-9907c2d0-f1b8-4f0a-9476-9752400f8a25 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-unplugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:05 user nova-compute[74963]: WARNING nova.compute.manager [req-10592f49-52f9-40ef-b060-c37d1aed1515 req-9907c2d0-f1b8-4f0a-9476-9752400f8a25 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-unplugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state active and task_state rescuing.
Nov 30 08:20:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "89333c12-d47d-4480-a04f-bd502abf3829" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:06 user nova-compute[74963]: INFO nova.compute.manager [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Terminating instance
Nov 30 08:20:06 user nova-compute[74963]: DEBUG nova.compute.manager [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Instance destroyed successfully.
Nov 30 08:20:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Attempting a stable device rescue
Nov 30 08:20:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74963) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Instance directory exists: not creating {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 08:20:06 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Creating image(s)
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "5941ca8409ed16f998d89b13fbfad0a33275f53c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "5941ca8409ed16f998d89b13fbfad0a33275f53c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c.part --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-b1f3aa83-7b76-4485-86a7-b6bc6f019f62 req-91b01fc7-dc18-45c4-b44e-cc75f846e8f5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b1f3aa83-7b76-4485-86a7-b6bc6f019f62 req-91b01fc7-dc18-45c4-b44e-cc75f846e8f5 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b1f3aa83-7b76-4485-86a7-b6bc6f019f62 req-91b01fc7-dc18-45c4-b44e-cc75f846e8f5 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b1f3aa83-7b76-4485-86a7-b6bc6f019f62 req-91b01fc7-dc18-45c4-b44e-cc75f846e8f5 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-b1f3aa83-7b76-4485-86a7-b6bc6f019f62 req-91b01fc7-dc18-45c4-b44e-cc75f846e8f5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-unplugged-3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-b1f3aa83-7b76-4485-86a7-b6bc6f019f62 req-91b01fc7-dc18-45c4-b44e-cc75f846e8f5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-3d981111-1e7a-44c8-8c22-d5c314992081 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-d1c20e23-6881-44d1-902c-47a591c83cf7 req-b200c913-331e-48b1-a5e1-c22ef7e7d5e0 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d1c20e23-6881-44d1-902c-47a591c83cf7 req-b200c913-331e-48b1-a5e1-c22ef7e7d5e0 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d1c20e23-6881-44d1-902c-47a591c83cf7 req-b200c913-331e-48b1-a5e1-c22ef7e7d5e0 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d1c20e23-6881-44d1-902c-47a591c83cf7 req-b200c913-331e-48b1-a5e1-c22ef7e7d5e0 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-d1c20e23-6881-44d1-902c-47a591c83cf7 req-b200c913-331e-48b1-a5e1-c22ef7e7d5e0 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-unplugged-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-d1c20e23-6881-44d1-902c-47a591c83cf7 req-b200c913-331e-48b1-a5e1-c22ef7e7d5e0 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-20953d60-33c1-4fc6-a18c-348e973adf58 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:07 user nova-compute[74963]: WARNING nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state active and task_state rescuing.
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-unplugged-413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-413e6908-6d37-4ae6-9817-d0876419a6ea for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-413e6908-6d37-4ae6-9817-d0876419a6ea {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:07 user nova-compute[74963]: WARNING nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-413e6908-6d37-4ae6-9817-d0876419a6ea for instance with vm_state active and task_state deleting.
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-unplugged-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-744f8361-9013-4250-8f88-e68375c254fe for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:07 user nova-compute[74963]: WARNING nova.compute.manager [req-fe1acf66-0a88-4e9e-bd94-78cc2baa2af8 req-9728ae4e-6395-4425-85f7-0c37b22049c1 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-744f8361-9013-4250-8f88-e68375c254fe for instance with vm_state active and task_state deleting.
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c.part --force-share --output=json" returned: 0 in 0.259s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.virt.images [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] 48cc57b9-c60c-44da-b122-0457f19d72e4 was qcow2, converting to raw {{(pid=74963) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:20:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c.part /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c.converted {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:08 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Instance destroyed successfully.
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c.part /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c.converted" returned: 0 in 0.311s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.objects.instance [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lazy-loading 'resources' on Instance uuid 89333c12-d47d-4480-a04f-bd502abf3829 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c.converted --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:8f:e6,bridge_name='br-int',has_traffic_filtering=True,id=20953d60-33c1-4fc6-a18c-348e973adf58,network=Network(b7682c3a-2150-407c-af83-12a9f0331bef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20953d60-33') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:8f:e6,bridge_name='br-int',has_traffic_filtering=True,id=20953d60-33c1-4fc6-a18c-348e973adf58,network=Network(b7682c3a-2150-407c-af83-12a9f0331bef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20953d60-33') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20953d60-33, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b3d8b09-4a7a-420d-8d95-03b6d87c9283) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "5941ca8409ed16f998d89b13fbfad0a33275f53c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.209s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "5941ca8409ed16f998d89b13fbfad0a33275f53c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "5941ca8409ed16f998d89b13fbfad0a33275f53c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-3d981111-1e7a-44c8-8c22-d5c314992081 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:08 user nova-compute[74963]: WARNING nova.compute.manager [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-3d981111-1e7a-44c8-8c22-d5c314992081 for instance with vm_state active and task_state deleting.
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-unplugged-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-6792760d-62a9-4138-a559-dede30e285a7 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:08 user nova-compute[74963]: WARNING nova.compute.manager [req-bce2b0db-3aac-4e45-930f-f4f93909ed21 req-40b615ea-b4f9-4da3-95fa-9d5b4d02b7b5 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-6792760d-62a9-4138-a559-dede30e285a7 for instance with vm_state active and task_state deleting.
Nov 30 08:20:08 user nova-compute[74963]: INFO os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:8f:e6,bridge_name='br-int',has_traffic_filtering=True,id=20953d60-33c1-4fc6-a18c-348e973adf58,network=Network(b7682c3a-2150-407c-af83-12a9f0331bef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20953d60-33')
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:90:01,bridge_name='br-int',has_traffic_filtering=True,id=3d981111-1e7a-44c8-8c22-d5c314992081,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d981111-1e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:90:01,bridge_name='br-int',has_traffic_filtering=True,id=3d981111-1e7a-44c8-8c22-d5c314992081,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d981111-1e') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d981111-1e, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:08 user nova-compute[74963]: WARNING nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-20953d60-33c1-4fc6-a18c-348e973adf58 for instance with vm_state active and task_state deleting.
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-unplugged-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-492dda05-4f87-4006-be77-1365e29ebc9e for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:08 user nova-compute[74963]: WARNING nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-492dda05-4f87-4006-be77-1365e29ebc9e for instance with vm_state active and task_state deleting.
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-unplugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-unplugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-plugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Acquiring lock "89333c12-d47d-4480-a04f-bd502abf3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] Lock "89333c12-d47d-4480-a04f-bd502abf3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] No waiting events found dispatching network-vif-plugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:08 user nova-compute[74963]: WARNING nova.compute.manager [req-82ed9d2d-72c7-45bf-80f9-7216172ab6f6 req-e62fcfe2-50d3-434a-983f-4338cc19051b service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received unexpected event network-vif-plugged-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 for instance with vm_state active and task_state deleting.
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0c7ba6a-e7d7-4c36-a5b5-21d3639e233a) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c,backing_fmt=raw /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5941ca8409ed16f998d89b13fbfad0a33275f53c,backing_fmt=raw /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue" returned: 0 in 0.055s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "5941ca8409ed16f998d89b13fbfad0a33275f53c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'migration_context' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: INFO os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:90:01,bridge_name='br-int',has_traffic_filtering=True,id=3d981111-1e7a-44c8-8c22-d5c314992081,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d981111-1e')
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=413e6908-6d37-4ae6-9817-d0876419a6ea,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap413e6908-6d') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=413e6908-6d37-4ae6-9817-d0876419a6ea,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap413e6908-6d') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.objects.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Object Instance<1528211a-3b92-46aa-8512-5c2568f361ea> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Start _get_guest_xml network_info=[{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "vif_mac": "fa:16:3e:ed:d5:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '48cc57b9-c60c-44da-b122-0457f19d72e4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbnTeIkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '1528211a-3b92-46aa-8512-5c2568f361ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'de544a0f-7e9e-41f7-8706-c2402010a750', 'serial': 'de544a0f-7e9e-41f7-8706-c2402010a750'}, 'attachment_id': '9550d3e8-5b85-4fa1-bf63-e2670c1d68d9', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'resources' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap413e6908-6d, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.objects.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Object Instance<1528211a-3b92-46aa-8512-5c2568f361ea> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'numa_topology' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.objects.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Object Instance<1528211a-3b92-46aa-8512-5c2568f361ea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:20:08 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80f6d509-00d8-47a4-af95-95e3064e5cea) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:08 user nova-compute[74963]: DEBUG nova.objects.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Object Instance<1528211a-3b92-46aa-8512-5c2568f361ea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbnTeIkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:20:09 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:09 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:09 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: INFO os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=413e6908-6d37-4ae6-9817-d0876419a6ea,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap413e6908-6d')
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b9:9d,bridge_name='br-int',has_traffic_filtering=True,id=744f8361-9013-4250-8f88-e68375c254fe,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8361-90') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b9:9d,bridge_name='br-int',has_traffic_filtering=True,id=744f8361-9013-4250-8f88-e68375c254fe,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8361-90') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap744f8361-90, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d17546-cd71-4c81-a4ca-8dbbec1fbfdd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pbnTeIkf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 08:20:09 user nova-compute[74963]: node.name = iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750
Nov 30 08:20:09 user nova-compute[74963]: node.tpgt = -1
Nov 30 08:20:09 user nova-compute[74963]: node.startup = automatic
Nov 30 08:20:09 user nova-compute[74963]: node.leading_login = No
Nov 30 08:20:09 user nova-compute[74963]: iface.iscsi_ifacename = default
Nov 30 08:20:09 user nova-compute[74963]: iface.net_ifacename = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.ipaddress = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.prefix_len = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.hwaddress = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.transport_name = tcp
Nov 30 08:20:09 user nova-compute[74963]: iface.initiatorname = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.state = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.vlan_id = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.vlan_priority = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.vlan_state = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.iface_num = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.mtu = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.port = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.bootproto = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.subnet_mask = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.gateway = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.dhcp_alt_client_id = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.dhcp_dns = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.dhcp_learn_iqn = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.dhcp_vendor_id_state = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.dhcp_vendor_id = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.dhcp_slp_da = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.fragmentation = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.gratuitous_arp = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.incoming_forwarding = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.tos_state = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.tos = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.ttl = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.delayed_ack = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.tcp_nagle = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.tcp_wsf_state = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.tcp_wsf = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.tcp_timer_scale = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.tcp_timestamp = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.redirect = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.def_task_mgmt_timeout = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.header_digest = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.data_digest = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.immediate_data = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.initial_r2t = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.data_seq_inorder = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.data_pdu_inorder = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.erl = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.max_receive_data_len = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.first_burst_len = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.max_outstanding_r2t = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.max_burst_len = 0
Nov 30 08:20:09 user nova-compute[74963]: iface.chap_auth = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.bidi_chap = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.strict_login_compliance = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.discovery_auth = <empty>
Nov 30 08:20:09 user nova-compute[74963]: iface.discovery_logout = <empty>
Nov 30 08:20:09 user nova-compute[74963]: node.discovery_address = <empty>
Nov 30 08:20:09 user nova-compute[74963]: node.discovery_port = 0
Nov 30 08:20:09 user nova-compute[74963]: node.discovery_type = static
Nov 30 08:20:09 user nova-compute[74963]: node.session.initial_cmdsn = 0
Nov 30 08:20:09 user nova-compute[74963]: node.session.initial_login_retry_max = 8
Nov 30 08:20:09 user nova-compute[74963]: node.session.xmit_thread_priority = -20
Nov 30 08:20:09 user nova-compute[74963]: node.session.cmds_max = 128
Nov 30 08:20:09 user nova-compute[74963]: node.session.queue_depth = 32
Nov 30 08:20:09 user nova-compute[74963]: node.session.nr_sessions = 1
Nov 30 08:20:09 user nova-compute[74963]: node.session.auth.authmethod = CHAP
Nov 30 08:20:09 user nova-compute[74963]: node.session.auth.username = pbnTeIkf
Nov 30 08:20:09 user nova-compute[74963]: node.session.auth.password = ***
Nov 30 08:20:09 user nova-compute[74963]: node.session.auth.username_in = <empty>
Nov 30 08:20:09 user nova-compute[74963]: node.session.auth.password_in = <empty>
Nov 30 08:20:09 user nova-compute[74963]: node.session.auth.chap_algs = MD5
Nov 30 08:20:09 user nova-compute[74963]: node.session.timeo.replacement_timeout = 120
Nov 30 08:20:09 user nova-compute[74963]: node.session.err_timeo.abort_timeout = 15
Nov 30 08:20:09 user nova-compute[74963]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 08:20:09 user nova-compute[74963]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 08:20:09 user nova-compute[74963]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.FastAbort = Yes
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.InitialR2T = No
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.ImmediateData = Yes
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.MaxConnections = 1
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 08:20:09 user nova-compute[74963]: node.session.iscsi.ERL = 0
Nov 30 08:20:09 user nova-compute[74963]: node.session.scan = manual
Nov 30 08:20:09 user nova-compute[74963]: node.session.reopen_max = 0
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].address = 172.16.0.220
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].port = 3260
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].startup = manual
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].tcp.window_size = 524288
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].tcp.type_of_service = 0
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].timeo.logout_timeout = 15
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].timeo.login_timeout = 15
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].timeo.auth_timeout = 45
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].iscsi.DataDigest = None
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].iscsi.IFMarker = No
Nov 30 08:20:09 user nova-compute[74963]: node.conn[0].iscsi.OFMarker = No
Nov 30 08:20:09 user nova-compute[74963]: # END RECORD
Nov 30 08:20:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3a4d70-6811-41f1-b335-3c2411a15fe3]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69818e51-5e9f-4a26-b553-d3b34f74459f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71eaf2fb-9b16-4399-9b27-ab34d9dac044) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbnTeIkf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbnTeIkf" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[35483fba-6e1b-484d-ae01-41fb770d8dfc]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pbnTeIkf'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: INFO os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b9:9d,bridge_name='br-int',has_traffic_filtering=True,id=744f8361-9013-4250-8f88-e68375c254fe,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8361-90')
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ce:c0,bridge_name='br-int',has_traffic_filtering=True,id=492dda05-4f87-4006-be77-1365e29ebc9e,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492dda05-4f') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ce:c0,bridge_name='br-int',has_traffic_filtering=True,id=492dda05-4f87-4006-be77-1365e29ebc9e,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492dda05-4f') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6279510c-6639-4597-86a8-e8e5aad727e2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap492dda05-4f, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1c1f5-f34b-47f6-b5dd-1c2a108a72f0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] HCTL ('36', '0', '0', 0) found on session 30 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3898c4a1-37ce-4478-b9b4-c38afdb08a44) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2d76da-dcde-4fd4-a97a-13e582cfa112]: (4, ('0 0 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Searching for a device in session 30 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbnTeIkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.264s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] <== connect_volume: return (266ms) {'type': 'block', 'scsi_wwn': '26463313061313130', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313061313130', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: INFO os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ce:c0,bridge_name='br-int',has_traffic_filtering=True,id=492dda05-4f87-4006-be77-1365e29ebc9e,network=Network(040e438f-c8d4-4028-a5a3-edd7bd93c3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492dda05-4f')
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "6792760d-62a9-4138-a559-dede30e285a7", "address": "fa:16:3e:c7:17:79", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6792760d-62", "ovs_interfaceid": "6792760d-62a9-4138-a559-dede30e285a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:17:79,bridge_name='br-int',has_traffic_filtering=True,id=6792760d-62a9-4138-a559-dede30e285a7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6792760d-62') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:17:79,bridge_name='br-int',has_traffic_filtering=True,id=6792760d-62a9-4138-a559-dede30e285a7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6792760d-62') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6792760d-62, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0bbb822-8b7e-4d19-8c3e-5eec50477c49) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-276068840',display_name='tempest-ServerStableDeviceRescueTest-server-276068840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-276068840',id=23,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE40jvwvsDQoaQ3t8TBNrzK6XW0OcvTn7nok9F/lP8HPBvrXhsdZBe+FtRUWZI/eJhWClnJvORdzk45IuI0V2vZfiANVF9lPL6ESNpM6LHAjFUbsb0BnY1YF/tvKV3F7SA==',key_name='tempest-keypair-1057764945',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='013793585eb2493d80b2bd27e64c4471',ramdisk_id='',reservation_id='r-x2r2tcfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1608184284',owner_user_name='tempest-ServerStableDeviceRescueTest-1608184284-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:18:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f051de260047f8af5e1cc872e4ae80',uuid=1528211a-3b92-46aa-8512-5c2568f361ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "vif_mac": "fa:16:3e:ed:d5:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Converting VIF {"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "vif_mac": "fa:16:3e:ed:d5:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:d5:1c,bridge_name='br-int',has_traffic_filtering=True,id=f76abde2-a558-4cba-a95d-959ac47f8746,network=Network(3070ea18-ada1-4d74-bf4f-9d95958aec61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76abde2-a5') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'pci_devices' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: INFO os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:17:79,bridge_name='br-int',has_traffic_filtering=True,id=6792760d-62a9-4138-a559-dede30e285a7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6792760d-62')
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T08:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1556095200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1556095200',id=26,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEe9tAlqVqvOxDXUslkO4MrxVW3h3QlaG6KAa7M4TOQk2AdwgbsepKP28QcajWGNKO9avt6NTNl4cZYrmBvS4dLTSRtN3vgrjBtQcGbfdAJIZMSThx3mK0DScY7bmCZ9A==',key_name='tempest-keypair-573256064',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ec828233be45a68aa720e4c5db2307',ramdisk_id='',reservation_id='r-8idfkyv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-297210878',owner_user_name='tempest-TaggedBootDevicesTest-297210878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e53966f2e443b0a3e0897c52ece8b8',uuid=89333c12-d47d-4480-a04f-bd502abf3829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converting VIF {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d0:3e,bridge_name='br-int',has_traffic_filtering=True,id=d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dd9dd9-dd') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d0:3e,bridge_name='br-int',has_traffic_filtering=True,id=d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dd9dd9-dd') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:09 user nova-compute[74963]: WARNING nova.compute.manager [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state stopped and task_state powering-on.
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.compute.manager [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:09 user nova-compute[74963]: WARNING nova.compute.manager [req-da39aa13-f12d-4874-9e78-aa1a0429467d req-208c2935-ba53-4cf5-b29b-a2066f415205 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state stopped and task_state powering-on.
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3dd9dd9-dd, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.objects.base [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Object Instance<1528211a-3b92-46aa-8512-5c2568f361ea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:20:09 user nova-compute[74963]:   <uuid>1528211a-3b92-46aa-8512-5c2568f361ea</uuid>
Nov 30 08:20:09 user nova-compute[74963]:   <name>instance-00000017</name>
Nov 30 08:20:09 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:20:09 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:20:09 user nova-compute[74963]:   <metadata>
Nov 30 08:20:09 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:20:09 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:20:09 user nova-compute[74963]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-276068840</nova:name>
Nov 30 08:20:09 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:20:08</nova:creationTime>
Nov 30 08:20:09 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:20:09 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:20:09 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:20:09 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:20:09 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:20:09 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:20:09 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:20:09 user nova-compute[74963]:       <nova:owner>
Nov 30 08:20:09 user nova-compute[74963]:         <nova:user uuid="e3f051de260047f8af5e1cc872e4ae80">tempest-ServerStableDeviceRescueTest-1608184284-project-member</nova:user>
Nov 30 08:20:09 user nova-compute[74963]:         <nova:project uuid="013793585eb2493d80b2bd27e64c4471">tempest-ServerStableDeviceRescueTest-1608184284</nova:project>
Nov 30 08:20:09 user nova-compute[74963]:       </nova:owner>
Nov 30 08:20:09 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:20:09 user nova-compute[74963]:       <nova:ports>
Nov 30 08:20:09 user nova-compute[74963]:         <nova:port uuid="f76abde2-a558-4cba-a95d-959ac47f8746">
Nov 30 08:20:09 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 08:20:09 user nova-compute[74963]:         </nova:port>
Nov 30 08:20:09 user nova-compute[74963]:       </nova:ports>
Nov 30 08:20:09 user nova-compute[74963]:     </nova:instance>
Nov 30 08:20:09 user nova-compute[74963]:   </metadata>
Nov 30 08:20:09 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:20:09 user nova-compute[74963]:     <system>
Nov 30 08:20:09 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:20:09 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:20:09 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:20:09 user nova-compute[74963]:       <entry name="serial">1528211a-3b92-46aa-8512-5c2568f361ea</entry>
Nov 30 08:20:09 user nova-compute[74963]:       <entry name="uuid">1528211a-3b92-46aa-8512-5c2568f361ea</entry>
Nov 30 08:20:09 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:20:09 user nova-compute[74963]:     </system>
Nov 30 08:20:09 user nova-compute[74963]:   </sysinfo>
Nov 30 08:20:09 user nova-compute[74963]:   <os>
Nov 30 08:20:09 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:20:09 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:20:09 user nova-compute[74963]:   </os>
Nov 30 08:20:09 user nova-compute[74963]:   <features>
Nov 30 08:20:09 user nova-compute[74963]:     <acpi/>
Nov 30 08:20:09 user nova-compute[74963]:     <apic/>
Nov 30 08:20:09 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:20:09 user nova-compute[74963]:   </features>
Nov 30 08:20:09 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:20:09 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:20:09 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:20:09 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:20:09 user nova-compute[74963]:   </clock>
Nov 30 08:20:09 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:20:09 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:20:09 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:20:09 user nova-compute[74963]:   </cpu>
Nov 30 08:20:09 user nova-compute[74963]:   <devices>
Nov 30 08:20:09 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:20:09 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:20:09 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk"/>
Nov 30 08:20:09 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:20:09 user nova-compute[74963]:     </disk>
Nov 30 08:20:09 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:20:09 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:20:09 user nova-compute[74963]:       <source dev="/dev/sde"/>
Nov 30 08:20:09 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:20:09 user nova-compute[74963]:       <serial>de544a0f-7e9e-41f7-8706-c2402010a750</serial>
Nov 30 08:20:09 user nova-compute[74963]:     </disk>
Nov 30 08:20:09 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:20:09 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:20:09 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue"/>
Nov 30 08:20:09 user nova-compute[74963]:       <target dev="vdc" bus="virtio"/>
Nov 30 08:20:09 user nova-compute[74963]:       <boot order="1"/>
Nov 30 08:20:09 user nova-compute[74963]:     </disk>
Nov 30 08:20:09 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:20:09 user nova-compute[74963]:       <mac address="fa:16:3e:ed:d5:1c"/>
Nov 30 08:20:09 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:20:09 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:20:09 user nova-compute[74963]:       <target dev="tapf76abde2-a5"/>
Nov 30 08:20:09 user nova-compute[74963]:     </interface>
Nov 30 08:20:09 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:20:09 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/console.log" append="off"/>
Nov 30 08:20:09 user nova-compute[74963]:     </serial>
Nov 30 08:20:09 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:20:09 user nova-compute[74963]:     <video>
Nov 30 08:20:09 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:20:09 user nova-compute[74963]:     </video>
Nov 30 08:20:09 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:20:09 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:20:09 user nova-compute[74963]:     </rng>
Nov 30 08:20:09 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:20:09 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:20:09 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:20:09 user nova-compute[74963]:     </memballoon>
Nov 30 08:20:09 user nova-compute[74963]:   </devices>
Nov 30 08:20:09 user nova-compute[74963]: </domain>
Nov 30 08:20:09 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1daf967f-981d-4e7c-86ef-6814ae5f7210) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:09 user nova-compute[74963]: INFO os_vif [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d0:3e,bridge_name='br-int',has_traffic_filtering=True,id=d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7,network=Network(bc8404be-62c2-4ce0-b18d-563951c5ce60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dd9dd9-dd')
Nov 30 08:20:09 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Instance destroyed successfully.
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgDVXCKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:20:09 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3131769-1db4-4fc0-af3c-61bc619d4020]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:20:09 user nova-compute[74963]: No targets found.
Nov 30 08:20:09 user nova-compute[74963]: iSNS:
Nov 30 08:20:09 user nova-compute[74963]: No targets found.
Nov 30 08:20:09 user nova-compute[74963]: STATIC:
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: FIRMWARE:
Nov 30 08:20:09 user nova-compute[74963]: No targets found.
Nov 30 08:20:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:20:09 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:20:09 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2773602-c01c-4280-8add-ba701648e76d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] No VIF found with MAC fa:16:3e:ed:d5:1c, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71b7bb7-e8e0-4804-adef-c5451e6312c8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622058ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851'): ({'sdg'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Removing single pathed devices sdg {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[621f9881-b459-4889-b11c-15b79284fda8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[72934471-e2bb-4554-a895-695e1603c2a7]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Flushing IO for device /dev/sdg {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0ab6fa-aaae-4cfb-84f2-db0a1b9ee493]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[db79784a-7b54-4bd9-b645-0cf390670a98]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] SCSI volumes sdg have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d33063-3fd7-4903-a047-eb2f6e82ec31]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ca09bb-59d5-4c0a-a6ed-a7b110e13f10]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851, portal: 172.16.0.220,3260]
Nov 30 08:20:09 user nova-compute[74963]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851, portal: 172.16.0.220,3260] successful.
Nov 30 08:20:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb894f67-d48b-45e4-b30c-726b1fd3d851 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5962e5ce-601f-40e4-bf60-ffbd8e7ee273]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] <== disconnect_volume: return (468ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUyAgklq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:20:09 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:09 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance rebooted successfully.
Nov 30 08:20:09 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7abd928-37c4-4e12-bd51-7e33ff1dfd43 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca3b62c-29c6-4544-9459-5425e7138239]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:20:09 user nova-compute[74963]: No targets found.
Nov 30 08:20:09 user nova-compute[74963]: iSNS:
Nov 30 08:20:09 user nova-compute[74963]: No targets found.
Nov 30 08:20:09 user nova-compute[74963]: STATIC:
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:20:09 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:09 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:09 user nova-compute[74963]: FIRMWARE:
Nov 30 08:20:09 user nova-compute[74963]: No targets found.
Nov 30 08:20:09 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:20:09 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:20:09 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:20:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff414d68-1381-4e29-80bb-daf432a8b11f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[818332bb-c61b-457e-ab62-67779c0a3381]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622058ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879'): ({'sdh'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Removing single pathed devices sdh {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e62504-c889-4252-847a-aad52dd89758]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afd092d-beb7-4467-87a3-69cc5c4a1604]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Flushing IO for device /dev/sdh {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8d98db-4107-495c-ad59-2c63dad76e50]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a61d80-9c34-4ba9-9dd3-844bf3c83195]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] SCSI volumes sdh have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a5b04-8658-470f-a469-11f1b227c3d0]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad34c4b-360f-47de-8395-68d5b9b1b3b5]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879, portal: 172.16.0.220,3260]
Nov 30 08:20:10 user nova-compute[74963]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879, portal: 172.16.0.220,3260] successful.
Nov 30 08:20:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf43e2db-5977-4b99-9abe-572574b07879 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fb1399-b4bf-463e-a941-c82a4df58617]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] <== disconnect_volume: return (421ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdTQhzVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:20:10 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d849ad2-3d69-4f2a-ba89-e8d9fed2d8f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:20:10 user nova-compute[74963]: No targets found.
Nov 30 08:20:10 user nova-compute[74963]: iSNS:
Nov 30 08:20:10 user nova-compute[74963]: No targets found.
Nov 30 08:20:10 user nova-compute[74963]: STATIC:
Nov 30 08:20:10 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:20:10 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:10 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:10 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff
Nov 30 08:20:10 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:10 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:10 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771
Nov 30 08:20:10 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:10 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:10 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750
Nov 30 08:20:10 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:10 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:10 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4
Nov 30 08:20:10 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:10 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:10 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:20:10 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:10 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:10 user nova-compute[74963]: FIRMWARE:
Nov 30 08:20:10 user nova-compute[74963]: No targets found.
Nov 30 08:20:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:20:10 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:20:10 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1b80b0-f272-45dd-9d57-da54e4d980c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14f33b2-e109-4bdb-a64d-590f54a25c82]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622058ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4'): ({'sdi'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Removing single pathed devices sdi {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3692b8-b21e-4362-a871-94f1e8cf89c5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[51043316-3410-44ea-afa6-b7e29a43ab40]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Flushing IO for device /dev/sdi {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc76c01-f6b2-4087-889e-e0f1ada3a0cc]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.055s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65dd76c-b446-4d0b-81fb-ddc534b01fa8]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] SCSI volumes sdi have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fdef4c-1fc1-4560-8709-9ecc0cd0d875]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb49d47-257c-4e3f-aebb-9e4f7ac06629]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4, portal: 172.16.0.220,3260]
Nov 30 08:20:10 user nova-compute[74963]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4, portal: 172.16.0.220,3260] successful.
Nov 30 08:20:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1c616f-ac1a-453a-9031-bb65b789afc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db9d7d4-0480-4698-8961-eaf52a3048dc]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] <== disconnect_volume: return (351ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:20:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:20:10 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Deleting instance files /opt/stack/data/nova/instances/89333c12-d47d-4480-a04f-bd502abf3829_del
Nov 30 08:20:10 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Deletion of /opt/stack/data/nova/instances/89333c12-d47d-4480-a04f-bd502abf3829_del complete
Nov 30 08:20:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG nova.compute.manager [req-7352648c-3358-4d9f-9d8f-05df16067c24 req-a12d643b-262f-4f80-b210-9634b1d3bf23 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7352648c-3358-4d9f-9d8f-05df16067c24 req-a12d643b-262f-4f80-b210-9634b1d3bf23 service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7352648c-3358-4d9f-9d8f-05df16067c24 req-a12d643b-262f-4f80-b210-9634b1d3bf23 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7352648c-3358-4d9f-9d8f-05df16067c24 req-a12d643b-262f-4f80-b210-9634b1d3bf23 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG nova.compute.manager [req-7352648c-3358-4d9f-9d8f-05df16067c24 req-a12d643b-262f-4f80-b210-9634b1d3bf23 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:11 user nova-compute[74963]: WARNING nova.compute.manager [req-7352648c-3358-4d9f-9d8f-05df16067c24 req-a12d643b-262f-4f80-b210-9634b1d3bf23 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state active and task_state rescuing.
Nov 30 08:20:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:11 user nova-compute[74963]: INFO nova.compute.manager [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Took 5.65 seconds to destroy the instance on the hypervisor.
Nov 30 08:20:11 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:20:13 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid '89333c12-d47d-4480-a04f-bd502abf3829' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid '89333c12-d47d-4480-a04f-bd502abf3829' (instance-0000001a)
Nov 30 08:20:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-a0c4b499-5d6e-43d7-9547-5e395104ff0d tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-e51a5d11-7d38-480f-9623-d1d9b3121c59 req-3aaec4eb-7cf6-4b67-a3ba-9a604f2f559c service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e51a5d11-7d38-480f-9623-d1d9b3121c59 req-3aaec4eb-7cf6-4b67-a3ba-9a604f2f559c service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e51a5d11-7d38-480f-9623-d1d9b3121c59 req-3aaec4eb-7cf6-4b67-a3ba-9a604f2f559c service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e51a5d11-7d38-480f-9623-d1d9b3121c59 req-3aaec4eb-7cf6-4b67-a3ba-9a604f2f559c service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-e51a5d11-7d38-480f-9623-d1d9b3121c59 req-3aaec4eb-7cf6-4b67-a3ba-9a604f2f559c service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:13 user nova-compute[74963]: WARNING nova.compute.manager [req-e51a5d11-7d38-480f-9623-d1d9b3121c59 req-3aaec4eb-7cf6-4b67-a3ba-9a604f2f559c service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state active and task_state rescuing.
Nov 30 08:20:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-09399408-682a-48c5-b647-d226920ff2d0 req-3249e722-d6d4-4205-830d-b300a945bb1a service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-deleted-6792760d-62a9-4138-a559-dede30e285a7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:14 user nova-compute[74963]: INFO nova.compute.manager [req-09399408-682a-48c5-b647-d226920ff2d0 req-3249e722-d6d4-4205-830d-b300a945bb1a service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Neutron deleted interface 6792760d-62a9-4138-a559-dede30e285a7; detaching it from the instance and deleting it from the info cache
Nov 30 08:20:14 user nova-compute[74963]: DEBUG nova.network.neutron [req-09399408-682a-48c5-b647-d226920ff2d0 req-3249e722-d6d4-4205-830d-b300a945bb1a service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [{"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "492dda05-4f87-4006-be77-1365e29ebc9e", "address": "fa:16:3e:bd:ce:c0", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492dda05-4f", "ovs_interfaceid": "492dda05-4f87-4006-be77-1365e29ebc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.428s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-09399408-682a-48c5-b647-d226920ff2d0 req-3249e722-d6d4-4205-830d-b300a945bb1a service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Detach interface failed, port_id=6792760d-62a9-4138-a559-dede30e285a7, reason: Instance 89333c12-d47d-4480-a04f-bd502abf3829 could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:14 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 is timed out.
Nov 30 08:20:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully detached device vdb from instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 from the live domain config.
Nov 30 08:20:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhjzBSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:20:14 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aac084-d804-4c59-a26a-eef6ea2ec04b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:20:14 user nova-compute[74963]: No targets found.
Nov 30 08:20:14 user nova-compute[74963]: iSNS:
Nov 30 08:20:14 user nova-compute[74963]: No targets found.
Nov 30 08:20:14 user nova-compute[74963]: STATIC:
Nov 30 08:20:14 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:20:14 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:14 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:14 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff
Nov 30 08:20:14 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:14 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:14 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771
Nov 30 08:20:14 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:14 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:14 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750
Nov 30 08:20:14 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:14 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:14 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:20:14 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:20:14 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:20:14 user nova-compute[74963]: FIRMWARE:
Nov 30 08:20:14 user nova-compute[74963]: No targets found.
Nov 30 08:20:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:20:14 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:20:14 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbf7a9c-203a-4827-8276-d330b53d07d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf800d-a9d8-471e-9272-2b4312011d46]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:14 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:14 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:14 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:14 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:20:14 user nova-compute[74963]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff (non-flash)
Nov 30 08:20:14 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:20:14 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:20:14 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:20:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62599863b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5075b-4994-44b1-931d-40fd4234486d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc55686d-3997-4044-84ad-aa3e48af2423]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[017cc6f9-a5b0-494b-a28f-bfbcd076d89a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c39a1-c8ae-44cc-a6be-d95e91249232]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c676002-02e2-4a3f-a19b-5a69d0e3cd2c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[95157f33-2b16-4a54-a0b2-adb5acfbf483]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260]
Nov 30 08:20:14 user nova-compute[74963]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff, portal: 172.16.0.220,3260] successful.
Nov 30 08:20:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b76d17-133b-4587-b9b0-8dc8ea688bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305b6a4-e6c3-4e28-aabe-3e1b9167ca32]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== disconnect_volume: return (419ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:20:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-deleted-492dda05-4f87-4006-be77-1365e29ebc9e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:15 user nova-compute[74963]: INFO nova.compute.manager [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Neutron deleted interface 492dda05-4f87-4006-be77-1365e29ebc9e; detaching it from the instance and deleting it from the info cache
Nov 30 08:20:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [{"id": "20953d60-33c1-4fc6-a18c-348e973adf58", "address": "fa:16:3e:2e:8f:e6", "network": {"id": "b7682c3a-2150-407c-af83-12a9f0331bef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-263134346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20953d60-33", "ovs_interfaceid": "20953d60-33c1-4fc6-a18c-348e973adf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.objects.instance [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'flavor' on Instance uuid 7c420b98-c113-4ce1-94e8-31e9e9525f67 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Detach interface failed, port_id=492dda05-4f87-4006-be77-1365e29ebc9e, reason: Instance 89333c12-d47d-4480-a04f-bd502abf3829 could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-deleted-20953d60-33c1-4fc6-a18c-348e973adf58 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:16 user nova-compute[74963]: INFO nova.compute.manager [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Neutron deleted interface 20953d60-33c1-4fc6-a18c-348e973adf58; detaching it from the instance and deleting it from the info cache
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.network.neutron [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [{"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "744f8361-9013-4250-8f88-e68375c254fe", "address": "fa:16:3e:11:b9:9d", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8361-90", "ovs_interfaceid": "744f8361-9013-4250-8f88-e68375c254fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:16 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:20:16 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7624MB free_disk=24.80910873413086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:16 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Took 4.61 seconds to deallocate network for instance.
Nov 30 08:20:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7f0584ff-0878-4005-bb01-ca5fac4a08c5 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.490s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Detach interface failed, port_id=20953d60-33c1-4fc6-a18c-348e973adf58, reason: Instance 89333c12-d47d-4480-a04f-bd502abf3829 could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-deleted-744f8361-9013-4250-8f88-e68375c254fe {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:16 user nova-compute[74963]: INFO nova.compute.manager [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Neutron deleted interface 744f8361-9013-4250-8f88-e68375c254fe; detaching it from the instance and deleting it from the info cache
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.network.neutron [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [{"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "address": "fa:16:3e:bb:d0:3e", "network": {"id": "bc8404be-62c2-4ce0-b18d-563951c5ce60", "bridge": "br-int", "label": "tempest-device-tagging-net2-357437610", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dd9dd9-dd", "ovs_interfaceid": "d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-12b4d694-1744-4a83-ac5a-073d185412b8 req-c7501caa-fb72-4459-85ca-84346fb9cb11 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Detach interface failed, port_id=744f8361-9013-4250-8f88-e68375c254fe, reason: Instance 89333c12-d47d-4480-a04f-bd502abf3829 could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance fd313577-5b50-48f3-b224-68542b958d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 7c420b98-c113-4ce1-94e8-31e9e9525f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1528211a-3b92-46aa-8512-5c2568f361ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 89333c12-d47d-4480-a04f-bd502abf3829 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:20:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.785s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Skipping network cache update for instance because it is being deleted. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.objects.instance [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lazy-loading 'info_cache' on Instance uuid 68bcb314-8197-4fe6-b986-b2554c822545 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-e6b17345-4121-46c4-a0c4-56145fb3d988 req-20e857a5-2183-4e4e-a914-9f3c36242310 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Received event network-vif-deleted-d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:17 user nova-compute[74963]: INFO nova.compute.manager [req-e6b17345-4121-46c4-a0c4-56145fb3d988 req-20e857a5-2183-4e4e-a914-9f3c36242310 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Neutron deleted interface d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7; detaching it from the instance and deleting it from the info cache
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.network.neutron [req-e6b17345-4121-46c4-a0c4-56145fb3d988 req-20e857a5-2183-4e4e-a914-9f3c36242310 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Updating instance_info_cache with network_info: [{"id": "3d981111-1e7a-44c8-8c22-d5c314992081", "address": "fa:16:3e:35:90:01", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d981111-1e", "ovs_interfaceid": "3d981111-1e7a-44c8-8c22-d5c314992081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "413e6908-6d37-4ae6-9817-d0876419a6ea", "address": "fa:16:3e:16:ee:69", "network": {"id": "040e438f-c8d4-4028-a5a3-edd7bd93c3fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-615809847", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ec828233be45a68aa720e4c5db2307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap413e6908-6d", "ovs_interfaceid": "413e6908-6d37-4ae6-9817-d0876419a6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-e6b17345-4121-46c4-a0c4-56145fb3d988 req-20e857a5-2183-4e4e-a914-9f3c36242310 service nova] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Detach interface failed, port_id=d3dd9dd9-dda6-43c0-9a7c-ef55b6ebc9b7, reason: Instance 89333c12-d47d-4480-a04f-bd502abf3829 could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updating instance_info_cache with network_info: [{"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-68bcb314-8197-4fe6-b986-b2554c822545" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:20:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:20:19 user nova-compute[74963]: INFO nova.compute.manager [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] [instance: 89333c12-d47d-4480-a04f-bd502abf3829] Took 2.74 seconds to detach 3 volumes for instance.
Nov 30 08:20:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:19 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:20:19 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:20:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:19 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Deleted allocations for instance 89333c12-d47d-4480-a04f-bd502abf3829
Nov 30 08:20:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9864313a-ff90-4c49-baad-7ca6bd73215f tempest-TaggedBootDevicesTest-297210878 tempest-TaggedBootDevicesTest-297210878-project-member] Lock "89333c12-d47d-4480-a04f-bd502abf3829" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.738s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-b053246b-a35c-4616-9e0d-7b50b5463a6d req-055067c1-86b9-4f56-87db-954d7cf7772a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received event network-changed-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-b053246b-a35c-4616-9e0d-7b50b5463a6d req-055067c1-86b9-4f56-87db-954d7cf7772a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Refreshing instance network info cache due to event network-changed-af87f011-b963-479f-8d02-ed38ce604c3d. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b053246b-a35c-4616-9e0d-7b50b5463a6d req-055067c1-86b9-4f56-87db-954d7cf7772a service nova] Acquiring lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b053246b-a35c-4616-9e0d-7b50b5463a6d req-055067c1-86b9-4f56-87db-954d7cf7772a service nova] Acquired lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-b053246b-a35c-4616-9e0d-7b50b5463a6d req-055067c1-86b9-4f56-87db-954d7cf7772a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Refreshing network info cache for port af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:26 user nova-compute[74963]: INFO nova.compute.manager [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Terminating instance
Nov 30 08:20:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-d34d906f-1b28-460c-a176-2012aa3d8818 req-818d37b1-d928-4f54-863c-4cec13260acb service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received event network-vif-unplugged-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d34d906f-1b28-460c-a176-2012aa3d8818 req-818d37b1-d928-4f54-863c-4cec13260acb service nova] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d34d906f-1b28-460c-a176-2012aa3d8818 req-818d37b1-d928-4f54-863c-4cec13260acb service nova] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d34d906f-1b28-460c-a176-2012aa3d8818 req-818d37b1-d928-4f54-863c-4cec13260acb service nova] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-d34d906f-1b28-460c-a176-2012aa3d8818 req-818d37b1-d928-4f54-863c-4cec13260acb service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] No waiting events found dispatching network-vif-unplugged-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-d34d906f-1b28-460c-a176-2012aa3d8818 req-818d37b1-d928-4f54-863c-4cec13260acb service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received event network-vif-unplugged-af87f011-b963-479f-8d02-ed38ce604c3d for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-b053246b-a35c-4616-9e0d-7b50b5463a6d req-055067c1-86b9-4f56-87db-954d7cf7772a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Updated VIF entry in instance network info cache for port af87f011-b963-479f-8d02-ed38ce604c3d. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG nova.network.neutron [req-b053246b-a35c-4616-9e0d-7b50b5463a6d req-055067c1-86b9-4f56-87db-954d7cf7772a service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Updating instance_info_cache with network_info: [{"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b053246b-a35c-4616-9e0d-7b50b5463a6d req-055067c1-86b9-4f56-87db-954d7cf7772a service nova] Releasing lock "refresh_cache-fd313577-5b50-48f3-b224-68542b958d21" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:20:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: fd313577-5b50-48f3-b224-68542b958d21] Instance destroyed successfully.
Nov 30 08:20:27 user nova-compute[74963]: DEBUG nova.objects.instance [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lazy-loading 'resources' on Instance uuid fd313577-5b50-48f3-b224-68542b958d21 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-44942850',display_name='tempest-TestStampPattern-server-44942850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-44942850',id=18,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXIfFHcf5hZJI1eOXWVSrzGJVOsClL3sRsQglOYWvzxqFcx/NwLGZqv1l34N2xD8aFbH1Lm1nfJS/HKaYuBZq5gxNl5qlH94PvOr+veB7phGIVgZOlhO4hSirM+QIZFUw==',key_name='tempest-TestStampPattern-1283092476',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:13:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fa068a8025245e0aa581bfad0b5c324',ramdisk_id='',reservation_id='r-r6338epo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-14898091',owner_user_name='tempest-TestStampPattern-14898091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:16:27Z,user_data=None,user_id='a0406077bdf143258a2d84290bb449da',uuid=fd313577-5b50-48f3-b224-68542b958d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converting VIF {"id": "af87f011-b963-479f-8d02-ed38ce604c3d", "address": "fa:16:3e:29:db:51", "network": {"id": "93e73fea-9195-4c53-a712-975983fbb959", "bridge": "br-int", "label": "tempest-TestStampPattern-840985439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa068a8025245e0aa581bfad0b5c324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf87f011-b9", "ovs_interfaceid": "af87f011-b963-479f-8d02-ed38ce604c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:db:51,bridge_name='br-int',has_traffic_filtering=True,id=af87f011-b963-479f-8d02-ed38ce604c3d,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf87f011-b9') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG os_vif [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:db:51,bridge_name='br-int',has_traffic_filtering=True,id=af87f011-b963-479f-8d02-ed38ce604c3d,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf87f011-b9') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf87f011-b9, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d84e467a-67b1-429e-b06a-aa2440b6d3f7) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:27 user nova-compute[74963]: INFO os_vif [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:db:51,bridge_name='br-int',has_traffic_filtering=True,id=af87f011-b963-479f-8d02-ed38ce604c3d,network=Network(93e73fea-9195-4c53-a712-975983fbb959),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf87f011-b9')
Nov 30 08:20:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Deleting instance files /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21_del
Nov 30 08:20:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Deletion of /opt/stack/data/nova/instances/fd313577-5b50-48f3-b224-68542b958d21_del complete
Nov 30 08:20:27 user nova-compute[74963]: INFO nova.compute.manager [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] [instance: fd313577-5b50-48f3-b224-68542b958d21] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 08:20:27 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: fd313577-5b50-48f3-b224-68542b958d21] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: fd313577-5b50-48f3-b224-68542b958d21] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: fd313577-5b50-48f3-b224-68542b958d21] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:27 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: fd313577-5b50-48f3-b224-68542b958d21] Took 0.47 seconds to deallocate network for instance.
Nov 30 08:20:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:28 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:20:28 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:20:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:28 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Deleted allocations for instance fd313577-5b50-48f3-b224-68542b958d21
Nov 30 08:20:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-76626ac4-c114-475c-a5d5-4ba37eef9ea9 tempest-TestStampPattern-14898091 tempest-TestStampPattern-14898091-project-member] Lock "fd313577-5b50-48f3-b224-68542b958d21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-594a30ea-6e9c-4421-b8eb-f0afec2d9a44 req-9fbf1449-94a6-4854-afc2-ff34c4ed5f54 service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received event network-vif-deleted-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-dfcff077-0284-415b-a3fb-135d2dcfc11b req-2b04a7e5-ea03-4024-a022-9f37aa2dadd9 service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received event network-vif-plugged-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dfcff077-0284-415b-a3fb-135d2dcfc11b req-2b04a7e5-ea03-4024-a022-9f37aa2dadd9 service nova] Acquiring lock "fd313577-5b50-48f3-b224-68542b958d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dfcff077-0284-415b-a3fb-135d2dcfc11b req-2b04a7e5-ea03-4024-a022-9f37aa2dadd9 service nova] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dfcff077-0284-415b-a3fb-135d2dcfc11b req-2b04a7e5-ea03-4024-a022-9f37aa2dadd9 service nova] Lock "fd313577-5b50-48f3-b224-68542b958d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-dfcff077-0284-415b-a3fb-135d2dcfc11b req-2b04a7e5-ea03-4024-a022-9f37aa2dadd9 service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] No waiting events found dispatching network-vif-plugged-af87f011-b963-479f-8d02-ed38ce604c3d {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:28 user nova-compute[74963]: WARNING nova.compute.manager [req-dfcff077-0284-415b-a3fb-135d2dcfc11b req-2b04a7e5-ea03-4024-a022-9f37aa2dadd9 service nova] [instance: fd313577-5b50-48f3-b224-68542b958d21] Received unexpected event network-vif-plugged-af87f011-b963-479f-8d02-ed38ce604c3d for instance with vm_state deleted and task_state None.
Nov 30 08:20:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:44 user nova-compute[74963]: INFO nova.compute.manager [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Terminating instance
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-13bb697d-0c4d-404f-81f5-e10a808519e1 req-33f22c30-b222-4914-87eb-35364e29725a service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-unplugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13bb697d-0c4d-404f-81f5-e10a808519e1 req-33f22c30-b222-4914-87eb-35364e29725a service nova] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13bb697d-0c4d-404f-81f5-e10a808519e1 req-33f22c30-b222-4914-87eb-35364e29725a service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13bb697d-0c4d-404f-81f5-e10a808519e1 req-33f22c30-b222-4914-87eb-35364e29725a service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-13bb697d-0c4d-404f-81f5-e10a808519e1 req-33f22c30-b222-4914-87eb-35364e29725a service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] No waiting events found dispatching network-vif-unplugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-13bb697d-0c4d-404f-81f5-e10a808519e1 req-33f22c30-b222-4914-87eb-35364e29725a service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-unplugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Instance destroyed successfully.
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.objects.instance [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'resources' on Instance uuid 7c420b98-c113-4ce1-94e8-31e9e9525f67 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T08:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-717755624',display_name='tempest-ServerActionsTestOtherA-server-742201224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-717755624',id=21,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGhTzyuOSLvbt34DavgeYG1BIdcE+3bBbpAiBsIdXmjz1e75zxd6ooC/FD4AaX8M1mz3vKXEWbpVF0g6gA9lKzklv7j1uEVOsgCpOxYQS4sQ7noSFAhgsTV6eQwf1hyPA==',key_name='tempest-keypair-513063568',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-miqeomp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=7c420b98-c113-4ce1-94e8-31e9e9525f67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "address": "fa:16:3e:b8:44:e8", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cae6733-e7", "ovs_interfaceid": "3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG os_vif [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cae6733-e7, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9f24270-f76b-4001-b690-683d7341c184) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:44 user nova-compute[74963]: INFO os_vif [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cae6733-e7')
Nov 30 08:20:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Deleting instance files /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67_del
Nov 30 08:20:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Deletion of /opt/stack/data/nova/instances/7c420b98-c113-4ce1-94e8-31e9e9525f67_del complete
Nov 30 08:20:44 user nova-compute[74963]: INFO nova.compute.manager [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 30 08:20:44 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:20:44 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:20:45 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:20:45 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Took 0.78 seconds to deallocate network for instance.
Nov 30 08:20:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:46 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:20:46 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:20:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:46 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Deleted allocations for instance 7c420b98-c113-4ce1-94e8-31e9e9525f67
Nov 30 08:20:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b5605eeb-e487-4506-8df1-b42db84c39c7 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-e2074882-c8a0-4bda-b9ec-bd7b49efa559 req-e5cd1d67-902a-4cec-902b-31b12d9b96ea service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2074882-c8a0-4bda-b9ec-bd7b49efa559 req-e5cd1d67-902a-4cec-902b-31b12d9b96ea service nova] Acquiring lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:20:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2074882-c8a0-4bda-b9ec-bd7b49efa559 req-e5cd1d67-902a-4cec-902b-31b12d9b96ea service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:20:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2074882-c8a0-4bda-b9ec-bd7b49efa559 req-e5cd1d67-902a-4cec-902b-31b12d9b96ea service nova] Lock "7c420b98-c113-4ce1-94e8-31e9e9525f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:20:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-e2074882-c8a0-4bda-b9ec-bd7b49efa559 req-e5cd1d67-902a-4cec-902b-31b12d9b96ea service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] No waiting events found dispatching network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:20:46 user nova-compute[74963]: WARNING nova.compute.manager [req-e2074882-c8a0-4bda-b9ec-bd7b49efa559 req-e5cd1d67-902a-4cec-902b-31b12d9b96ea service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received unexpected event network-vif-plugged-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 for instance with vm_state deleted and task_state None.
Nov 30 08:20:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-e2074882-c8a0-4bda-b9ec-bd7b49efa559 req-e5cd1d67-902a-4cec-902b-31b12d9b96ea service nova] [instance: 7c420b98-c113-4ce1-94e8-31e9e9525f67] Received event network-vif-deleted-3cae6733-e7ce-4ae0-ac51-a265bd3aa2a1 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:20:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:20:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:21:06 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:08 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:11 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:21:11 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7777MB free_disk=24.961044311523438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1528211a-3b92-46aa-8512-5c2568f361ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:21:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:21:12 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:21:12 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:21:12 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:21:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updating instance_info_cache with network_info: [{"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-70392773-3fa7-4fb1-8513-9f0391f9e0e0" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:21:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:21:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:21:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:21 user nova-compute[74963]: INFO nova.compute.manager [None req-f49c6c29-896c-4bcd-b797-188db39e7935 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Unrescuing
Nov 30 08:21:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f49c6c29-896c-4bcd-b797-188db39e7935 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:21:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f49c6c29-896c-4bcd-b797-188db39e7935 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquired lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:21:21 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f49c6c29-896c-4bcd-b797-188db39e7935 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:21:21 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f49c6c29-896c-4bcd-b797-188db39e7935 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Updating instance_info_cache with network_info: [{"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:21:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f49c6c29-896c-4bcd-b797-188db39e7935 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Releasing lock "refresh_cache-38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:21:21 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f49c6c29-896c-4bcd-b797-188db39e7935 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'flavor' on Instance uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:22 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:22 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-8a9be28d-7eda-4cc4-934c-d14c78f8a744 req-67e2b7d2-719a-4123-983b-fc53002a568a service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-unplugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8a9be28d-7eda-4cc4-934c-d14c78f8a744 req-67e2b7d2-719a-4123-983b-fc53002a568a service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8a9be28d-7eda-4cc4-934c-d14c78f8a744 req-67e2b7d2-719a-4123-983b-fc53002a568a service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8a9be28d-7eda-4cc4-934c-d14c78f8a744 req-67e2b7d2-719a-4123-983b-fc53002a568a service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-8a9be28d-7eda-4cc4-934c-d14c78f8a744 req-67e2b7d2-719a-4123-983b-fc53002a568a service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-unplugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:22 user nova-compute[74963]: WARNING nova.compute.manager [req-8a9be28d-7eda-4cc4-934c-d14c78f8a744 req-67e2b7d2-719a-4123-983b-fc53002a568a service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-unplugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:21:22 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Instance destroyed successfully.
Nov 30 08:21:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:24 user nova-compute[74963]: WARNING nova.compute.manager [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:21:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:24 user nova-compute[74963]: WARNING nova.compute.manager [req-b311ad18-c922-4665-beda-faeac9fb290a req-89f65e55-eac9-4a4d-b44e-ac69498c1c7d service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:21:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-b0d843b9-5f69-4aff-a17c-2bddc102c5f8 req-a9a9ce6a-7d5f-4e85-b666-cba2fbeca45f service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-changed-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-b0d843b9-5f69-4aff-a17c-2bddc102c5f8 req-a9a9ce6a-7d5f-4e85-b666-cba2fbeca45f service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Refreshing instance network info cache due to event network-changed-954e13fe-66db-4b7f-9ff1-ad70f956e95f. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b0d843b9-5f69-4aff-a17c-2bddc102c5f8 req-a9a9ce6a-7d5f-4e85-b666-cba2fbeca45f service nova] Acquiring lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b0d843b9-5f69-4aff-a17c-2bddc102c5f8 req-a9a9ce6a-7d5f-4e85-b666-cba2fbeca45f service nova] Acquired lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG nova.network.neutron [req-b0d843b9-5f69-4aff-a17c-2bddc102c5f8 req-a9a9ce6a-7d5f-4e85-b666-cba2fbeca45f service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Refreshing network info cache for port 954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG nova.objects.instance [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'flavor' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG nova.network.neutron [req-b0d843b9-5f69-4aff-a17c-2bddc102c5f8 req-a9a9ce6a-7d5f-4e85-b666-cba2fbeca45f service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updated VIF entry in instance network info cache for port 954e13fe-66db-4b7f-9ff1-ad70f956e95f. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG nova.network.neutron [req-b0d843b9-5f69-4aff-a17c-2bddc102c5f8 req-a9a9ce6a-7d5f-4e85-b666-cba2fbeca45f service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updating instance_info_cache with network_info: [{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b0d843b9-5f69-4aff-a17c-2bddc102c5f8 req-a9a9ce6a-7d5f-4e85-b666-cba2fbeca45f service nova] Releasing lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:25 user nova-compute[74963]: INFO nova.compute.manager [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Attaching volume 3d599c96-806d-4363-95be-3d98b1f92811 to /dev/vdb
Nov 30 08:21:25 user nova-compute[74963]: DEBUG os_brick.utils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[938a98a6-9912-44d2-b4c5-d5e99fe51348]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f49c6c29-896c-4bcd-b797-188db39e7935 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe383ae-c6cd-4dd7-8a9b-4cde30dd3ab8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b31aef-898b-4775-97d3-d17306a5c8c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe7c7c6-de8d-4867-ac6a-5c0b2b152d47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:21:26 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eae7bb4-ed16-4d94-aad1-ef7b281be784]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG os_brick.utils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updating existing volume attachment record: 4f11d0ae-eb6d-444b-b551-d3a4af304752 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-a0206f09-70b9-4205-909e-7705856c6d47 req-d5b0f7e9-e004-4da3-827a-5f6973df148e service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0206f09-70b9-4205-909e-7705856c6d47 req-d5b0f7e9-e004-4da3-827a-5f6973df148e service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0206f09-70b9-4205-909e-7705856c6d47 req-d5b0f7e9-e004-4da3-827a-5f6973df148e service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0206f09-70b9-4205-909e-7705856c6d47 req-d5b0f7e9-e004-4da3-827a-5f6973df148e service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-a0206f09-70b9-4205-909e-7705856c6d47 req-d5b0f7e9-e004-4da3-827a-5f6973df148e service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:26 user nova-compute[74963]: WARNING nova.compute.manager [req-a0206f09-70b9-4205-909e-7705856c6d47 req-d5b0f7e9-e004-4da3-827a-5f6973df148e service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state active and task_state None.
Nov 30 08:21:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:21:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQTwSgzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:21:35 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:21:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:21:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:21:35 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:21:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:21:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:21:35 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:21:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02316c7-110d-41ba-8f61-eb6b8dcefeae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:21:35 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[234ecd31-d5b0-48a3-b50f-aa49460ec553]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811] added
Nov 30 08:21:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a39058-2ede-4f86-9c35-7e25fc07e665]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7634bdc4-9037-453b-8d29-63b0600ade2e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQTwSgzI {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQTwSgzI" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee5bb2c-fc27-49b8-be48-2882c2fdff98]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hQTwSgzI'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[01511f71-5bd5-4c20-a97c-bac64be7cb2a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fded02-467d-4d54-9707-15cbcb9a5ce3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fec590-7e2e-4683-8883-d646b9ebdbfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811, portal: 172.16.0.220,3260]
Nov 30 08:21:36 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811, portal: 172.16.0.220,3260] successful.
Nov 30 08:21:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f50768-6637-4ed6-9e29-2f9af489b6fb]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5d68e9-f04b-42b0-bff9-6eda0b7fc807]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:21:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[692b6af9-35c7-4f39-9c42-f1326a53398b]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:21:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQTwSgzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:21:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:21:37 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26433646136636434', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:21:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433646136636434', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:21:37 user nova-compute[74963]: DEBUG nova.objects.instance [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'flavor' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:21:37 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:21:37 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:21:37 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:21:37 user nova-compute[74963]:   <serial>3d599c96-806d-4363-95be-3d98b1f92811</serial>
Nov 30 08:21:37 user nova-compute[74963]: </disk>
Nov 30 08:21:37 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:21:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:21:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:21:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No VIF found with MAC fa:16:3e:7b:7e:2f, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:21:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5da75e2b-e85f-4bb9-a035-ad40e4ed9f7a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.118s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:39 user nova-compute[74963]: INFO nova.compute.manager [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Rescuing
Nov 30 08:21:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:21:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquired lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:21:39 user nova-compute[74963]: DEBUG nova.network.neutron [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:21:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG nova.network.neutron [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updating instance_info_cache with network_info: [{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Releasing lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-3a820011-aa1e-4b22-90ff-92cfb6847278 req-7a812019-5f97-4a00-a59b-a4bd768950ef service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-unplugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3a820011-aa1e-4b22-90ff-92cfb6847278 req-7a812019-5f97-4a00-a59b-a4bd768950ef service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3a820011-aa1e-4b22-90ff-92cfb6847278 req-7a812019-5f97-4a00-a59b-a4bd768950ef service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3a820011-aa1e-4b22-90ff-92cfb6847278 req-7a812019-5f97-4a00-a59b-a4bd768950ef service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-3a820011-aa1e-4b22-90ff-92cfb6847278 req-7a812019-5f97-4a00-a59b-a4bd768950ef service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-unplugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:40 user nova-compute[74963]: WARNING nova.compute.manager [req-3a820011-aa1e-4b22-90ff-92cfb6847278 req-7a812019-5f97-4a00-a59b-a4bd768950ef service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-unplugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state active and task_state rescuing.
Nov 30 08:21:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:40 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Instance destroyed successfully.
Nov 30 08:21:40 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Attempting rescue
Nov 30 08:21:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74963) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Instance directory exists: not creating {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 08:21:40 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Creating image(s)
Nov 30 08:21:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG nova.objects.instance [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'trusted_certs' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue" returned: 0 in 0.050s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'migration_context' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.base [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<09f16ba8-8601-4fbf-a87a-fd84525f99ca> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Start _get_guest_xml network_info=[{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "vif_mac": "fa:16:3e:7b:7e:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'resources' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.base [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<09f16ba8-8601-4fbf-a87a-fd84525f99ca> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'numa_topology' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.base [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<09f16ba8-8601-4fbf-a87a-fd84525f99ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:21:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:21:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'vcpu_model' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.base [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<09f16ba8-8601-4fbf-a87a-fd84525f99ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1792156780',display_name='tempest-ServerRescueNegativeTestJSON-server-1792156780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1792156780',id=27,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw45HBZ5xU19gc9vrUU/5CeRU2AmyOb8wCG3xs4Xu+gBPBjAO9Y32a7/m95UeqCYXma7Nc/crom/3bi0PJ9GohtwPeZABzy2+eRhQoizkFvRsYJkg+rOrhXUUklTA5pSQ==',key_name='tempest-keypair-330175841',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-bcymuq0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b068a21b7ee04d14984abc97e582aa63',uuid=09f16ba8-8601-4fbf-a87a-fd84525f99ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "vif_mac": "fa:16:3e:7b:7e:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "vif_mac": "fa:16:3e:7b:7e:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:7e:2f,bridge_name='br-int',has_traffic_filtering=True,id=954e13fe-66db-4b7f-9ff1-ad70f956e95f,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap954e13fe-66') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'pci_devices' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.objects.base [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Object Instance<09f16ba8-8601-4fbf-a87a-fd84525f99ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:21:41 user nova-compute[74963]:   <uuid>09f16ba8-8601-4fbf-a87a-fd84525f99ca</uuid>
Nov 30 08:21:41 user nova-compute[74963]:   <name>instance-0000001b</name>
Nov 30 08:21:41 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:21:41 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:21:41 user nova-compute[74963]:   <metadata>
Nov 30 08:21:41 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:21:41 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:21:41 user nova-compute[74963]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1792156780</nova:name>
Nov 30 08:21:41 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:21:41</nova:creationTime>
Nov 30 08:21:41 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:21:41 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:21:41 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:21:41 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:21:41 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:21:41 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:21:41 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:21:41 user nova-compute[74963]:       <nova:owner>
Nov 30 08:21:41 user nova-compute[74963]:         <nova:user uuid="b068a21b7ee04d14984abc97e582aa63">tempest-ServerRescueNegativeTestJSON-1047810333-project-member</nova:user>
Nov 30 08:21:41 user nova-compute[74963]:         <nova:project uuid="c1d09678c8a049bca20bed732eedd231">tempest-ServerRescueNegativeTestJSON-1047810333</nova:project>
Nov 30 08:21:41 user nova-compute[74963]:       </nova:owner>
Nov 30 08:21:41 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:21:41 user nova-compute[74963]:       <nova:ports>
Nov 30 08:21:41 user nova-compute[74963]:         <nova:port uuid="954e13fe-66db-4b7f-9ff1-ad70f956e95f">
Nov 30 08:21:41 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:21:41 user nova-compute[74963]:         </nova:port>
Nov 30 08:21:41 user nova-compute[74963]:       </nova:ports>
Nov 30 08:21:41 user nova-compute[74963]:     </nova:instance>
Nov 30 08:21:41 user nova-compute[74963]:   </metadata>
Nov 30 08:21:41 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:21:41 user nova-compute[74963]:     <system>
Nov 30 08:21:41 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:21:41 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:21:41 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:21:41 user nova-compute[74963]:       <entry name="serial">09f16ba8-8601-4fbf-a87a-fd84525f99ca</entry>
Nov 30 08:21:41 user nova-compute[74963]:       <entry name="uuid">09f16ba8-8601-4fbf-a87a-fd84525f99ca</entry>
Nov 30 08:21:41 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:21:41 user nova-compute[74963]:     </system>
Nov 30 08:21:41 user nova-compute[74963]:   </sysinfo>
Nov 30 08:21:41 user nova-compute[74963]:   <os>
Nov 30 08:21:41 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:21:41 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:21:41 user nova-compute[74963]:   </os>
Nov 30 08:21:41 user nova-compute[74963]:   <features>
Nov 30 08:21:41 user nova-compute[74963]:     <acpi/>
Nov 30 08:21:41 user nova-compute[74963]:     <apic/>
Nov 30 08:21:41 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:21:41 user nova-compute[74963]:   </features>
Nov 30 08:21:41 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:21:41 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:21:41 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:21:41 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:21:41 user nova-compute[74963]:   </clock>
Nov 30 08:21:41 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:21:41 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:21:41 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:21:41 user nova-compute[74963]:   </cpu>
Nov 30 08:21:41 user nova-compute[74963]:   <devices>
Nov 30 08:21:41 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:21:41 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:21:41 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue"/>
Nov 30 08:21:41 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:21:41 user nova-compute[74963]:     </disk>
Nov 30 08:21:41 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:21:41 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:21:41 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk"/>
Nov 30 08:21:41 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:21:41 user nova-compute[74963]:     </disk>
Nov 30 08:21:41 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:21:41 user nova-compute[74963]:       <mac address="fa:16:3e:7b:7e:2f"/>
Nov 30 08:21:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:21:41 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:21:41 user nova-compute[74963]:       <target dev="tap954e13fe-66"/>
Nov 30 08:21:41 user nova-compute[74963]:     </interface>
Nov 30 08:21:41 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:21:41 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/console.log" append="off"/>
Nov 30 08:21:41 user nova-compute[74963]:     </serial>
Nov 30 08:21:41 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:21:41 user nova-compute[74963]:     <video>
Nov 30 08:21:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:21:41 user nova-compute[74963]:     </video>
Nov 30 08:21:41 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:21:41 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:21:41 user nova-compute[74963]:     </rng>
Nov 30 08:21:41 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:21:41 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:21:41 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:21:41 user nova-compute[74963]:     </memballoon>
Nov 30 08:21:41 user nova-compute[74963]:   </devices>
Nov 30 08:21:41 user nova-compute[74963]: </domain>
Nov 30 08:21:41 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:21:41 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Instance destroyed successfully.
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:21:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] No VIF found with MAC fa:16:3e:7b:7e:2f, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:21:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-0975a0d6-eb67-4c5f-b3b5-0f4e532270dc req-1eaee683-b273-46b1-b6f0-9d68bb514c8a service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0975a0d6-eb67-4c5f-b3b5-0f4e532270dc req-1eaee683-b273-46b1-b6f0-9d68bb514c8a service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0975a0d6-eb67-4c5f-b3b5-0f4e532270dc req-1eaee683-b273-46b1-b6f0-9d68bb514c8a service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0975a0d6-eb67-4c5f-b3b5-0f4e532270dc req-1eaee683-b273-46b1-b6f0-9d68bb514c8a service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-0975a0d6-eb67-4c5f-b3b5-0f4e532270dc req-1eaee683-b273-46b1-b6f0-9d68bb514c8a service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:42 user nova-compute[74963]: WARNING nova.compute.manager [req-0975a0d6-eb67-4c5f-b3b5-0f4e532270dc req-1eaee683-b273-46b1-b6f0-9d68bb514c8a service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state active and task_state rescuing.
Nov 30 08:21:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "06578dba-7003-4d6f-9500-086ba85ebee6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:21:43 user nova-compute[74963]: INFO nova.compute.claims [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Claim successful on node user
Nov 30 08:21:43 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG nova.network.neutron [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:21:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:21:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:21:43 user nova-compute[74963]: INFO nova.virt.block_device [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Booting with volume 618fb746-5223-416c-90a6-2fe2225c714a at /dev/vda
Nov 30 08:21:43 user nova-compute[74963]: DEBUG nova.policy [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38459c26cb7c4d229c2d9bdbfed447cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77b6f8fefeb4df5b8da6752ae8d0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG os_brick.utils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd0aa4f-cefd-4e1e-b83d-61b1d775acbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a747e540-1da1-4f99-a93b-b02208c73162]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad7b621-b85a-4c3c-a9ea-a1d3d8671fed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfc43a9-b080-44b1-b274-d98f1dd9d352]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:21:44 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0874d8b-01a1-4c2d-bf8d-581339ece893]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG os_brick.utils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Updating existing volume attachment record: 4aecee82-f856-4a8d-adfe-e0b338e320b3 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG nova.network.neutron [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Successfully created port: 355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:44 user nova-compute[74963]: WARNING nova.compute.manager [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state active and task_state rescuing.
Nov 30 08:21:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:44 user nova-compute[74963]: WARNING nova.compute.manager [req-423506df-7c9e-4b54-814e-d94b10d2b66c req-ec844689-3c01-488f-9d39-aae69a7d1dd5 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state active and task_state rescuing.
Nov 30 08:21:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-219d8955-2b66-4b1c-82bb-11b4aecf36c1 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:21:45 user nova-compute[74963]: DEBUG nova.network.neutron [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Successfully updated port: 355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:21:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "refresh_cache-06578dba-7003-4d6f-9500-086ba85ebee6" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:21:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquired lock "refresh_cache-06578dba-7003-4d6f-9500-086ba85ebee6" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:21:45 user nova-compute[74963]: DEBUG nova.network.neutron [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:21:45 user nova-compute[74963]: DEBUG nova.network.neutron [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:21:45 user nova-compute[74963]: DEBUG nova.network.neutron [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Updating instance_info_cache with network_info: [{"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:21:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Releasing lock "refresh_cache-06578dba-7003-4d6f-9500-086ba85ebee6" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:21:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance network_info: |[{"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:21:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-eb935478-185d-4d1b-99c0-da73c366121d req-59fe2017-82b7-4462-ad91-728aa174743f service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-changed-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-eb935478-185d-4d1b-99c0-da73c366121d req-59fe2017-82b7-4462-ad91-728aa174743f service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Refreshing instance network info cache due to event network-changed-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:21:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-eb935478-185d-4d1b-99c0-da73c366121d req-59fe2017-82b7-4462-ad91-728aa174743f service nova] Acquiring lock "refresh_cache-06578dba-7003-4d6f-9500-086ba85ebee6" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:21:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-eb935478-185d-4d1b-99c0-da73c366121d req-59fe2017-82b7-4462-ad91-728aa174743f service nova] Acquired lock "refresh_cache-06578dba-7003-4d6f-9500-086ba85ebee6" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:21:46 user nova-compute[74963]: DEBUG nova.network.neutron [req-eb935478-185d-4d1b-99c0-da73c366121d req-59fe2017-82b7-4462-ad91-728aa174743f service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Refreshing network info cache for port 355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:21:47 user nova-compute[74963]: DEBUG nova.network.neutron [req-eb935478-185d-4d1b-99c0-da73c366121d req-59fe2017-82b7-4462-ad91-728aa174743f service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Updated VIF entry in instance network info cache for port 355e7ed6-0e7a-430c-8d27-78f8c9bffbfd. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:21:47 user nova-compute[74963]: DEBUG nova.network.neutron [req-eb935478-185d-4d1b-99c0-da73c366121d req-59fe2017-82b7-4462-ad91-728aa174743f service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Updating instance_info_cache with network_info: [{"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:21:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-eb935478-185d-4d1b-99c0-da73c366121d req-59fe2017-82b7-4462-ad91-728aa174743f service nova] Releasing lock "refresh_cache-06578dba-7003-4d6f-9500-086ba85ebee6" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:21:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:51 user nova-compute[74963]: INFO nova.compute.manager [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Detaching volume 65d1e2f3-3675-4fcd-9bf5-771135fca771
Nov 30 08:21:51 user nova-compute[74963]: INFO nova.virt.block_device [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Attempting to driver detach volume 65d1e2f3-3675-4fcd-9bf5-771135fca771 from mountpoint /dev/vdb
Nov 30 08:21:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Attempting to detach device vdb from instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:21:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:21:51 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:21:51 user nova-compute[74963]:   <source dev="/dev/sdf"/>
Nov 30 08:21:51 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:21:51 user nova-compute[74963]:   <serial>65d1e2f3-3675-4fcd-9bf5-771135fca771</serial>
Nov 30 08:21:51 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 08:21:51 user nova-compute[74963]: </disk>
Nov 30 08:21:51 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:21:51 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully detached device vdb from instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 from the persistent domain config.
Nov 30 08:21:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:21:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:21:51 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:21:51 user nova-compute[74963]:   <source dev="/dev/sdf"/>
Nov 30 08:21:51 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:21:51 user nova-compute[74963]:   <serial>65d1e2f3-3675-4fcd-9bf5-771135fca771</serial>
Nov 30 08:21:51 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 08:21:51 user nova-compute[74963]: </disk>
Nov 30 08:21:51 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:21:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:21:53 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Creating image(s)
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Ensure instance console log exists: /opt/stack/data/nova/instances/06578dba-7003-4d6f-9500-086ba85ebee6/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Start _get_guest_xml network_info=[{"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REqzrnPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06578dba-7003-4d6f-9500-086ba85ebee6', 'attached_at': '', 'detached_at': '', 'volume_id': '618fb746-5223-416c-90a6-2fe2225c714a', 'serial': '618fb746-5223-416c-90a6-2fe2225c714a'}, 'attachment_id': '4aecee82-f856-4a8d-adfe-e0b338e320b3', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:21:53 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:21:53 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REqzrnPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:21:53 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:21:53 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:21:53 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bde1680-9998-426b-a829-5abcd2b6bed7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:21:53 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb58218-ba30-4a6d-ac14-0e0945d66ab7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a] added
Nov 30 08:21:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb2a16e-099d-4081-a7b1-eeb304b0bd01]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c29107-5960-4229-8cd9-de9c82046248]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REqzrnPG {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REqzrnPG" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7affd957-7d03-4820-bc06-cd00000c4261]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'REqzrnPG'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1db5fd-4dca-45ca-9ea2-7740ae97247a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[554e57e9-d069-4b04-b560-e2ce764fb8c2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a712c278-8661-4670-9461-ab257690e40c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260]
Nov 30 08:21:54 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260] successful.
Nov 30 08:21:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b27c468-f012-4e98-93fa-8adfccf36a86]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcda19e2-026b-4199-bbb4-dc1cd9699f9d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:21:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:21:54 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:21:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49e9358-cfef-476c-83b1-2783aac95abf]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REqzrnPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: INFO nova.compute.manager [None req-3515cf0c-982c-4595-8238-445ed2232e01 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Unrescuing
Nov 30 08:21:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3515cf0c-982c-4595-8238-445ed2232e01 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3515cf0c-982c-4595-8238-445ed2232e01 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquired lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3515cf0c-982c-4595-8238-445ed2232e01 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23564333766333661', 'path': '/dev/sdg'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564333766333661', 'path': '/dev/sdg'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1978623399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1978623399',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPo15KF1HXLEyPpa+4O3PhxaN/ETMyQMGcI46Pp8izb9WazA93d3bhxCfOy90R6rUR5VCwbkC4GFrn21BszijXxqyFgAYkvjek38GdhPOnd1W1Jq/0lAq/720Jrz55UsQ==',key_name='tempest-keypair-765355062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c77b6f8fefeb4df5b8da6752ae8d0a90',ramdisk_id='',reservation_id='r-8gmjeasr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1218377200',owner_user_name='tempest-ServerActionsV293TestJSON-1218377200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38459c26cb7c4d229c2d9bdbfed447cb',uuid=06578dba-7003-4d6f-9500-086ba85ebee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converting VIF {"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.objects.instance [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lazy-loading 'pci_devices' on Instance uuid 06578dba-7003-4d6f-9500-086ba85ebee6 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:21:55 user nova-compute[74963]:   <uuid>06578dba-7003-4d6f-9500-086ba85ebee6</uuid>
Nov 30 08:21:55 user nova-compute[74963]:   <name>instance-0000001c</name>
Nov 30 08:21:55 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:21:55 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:21:55 user nova-compute[74963]:   <metadata>
Nov 30 08:21:55 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:21:55 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:21:55 user nova-compute[74963]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1978623399</nova:name>
Nov 30 08:21:55 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:21:53</nova:creationTime>
Nov 30 08:21:55 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:21:55 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:21:55 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:21:55 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:21:55 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:21:55 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:21:55 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:21:55 user nova-compute[74963]:       <nova:owner>
Nov 30 08:21:55 user nova-compute[74963]:         <nova:user uuid="38459c26cb7c4d229c2d9bdbfed447cb">tempest-ServerActionsV293TestJSON-1218377200-project-member</nova:user>
Nov 30 08:21:55 user nova-compute[74963]:         <nova:project uuid="c77b6f8fefeb4df5b8da6752ae8d0a90">tempest-ServerActionsV293TestJSON-1218377200</nova:project>
Nov 30 08:21:55 user nova-compute[74963]:       </nova:owner>
Nov 30 08:21:55 user nova-compute[74963]:       <nova:ports>
Nov 30 08:21:55 user nova-compute[74963]:         <nova:port uuid="355e7ed6-0e7a-430c-8d27-78f8c9bffbfd">
Nov 30 08:21:55 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:21:55 user nova-compute[74963]:         </nova:port>
Nov 30 08:21:55 user nova-compute[74963]:       </nova:ports>
Nov 30 08:21:55 user nova-compute[74963]:     </nova:instance>
Nov 30 08:21:55 user nova-compute[74963]:   </metadata>
Nov 30 08:21:55 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:21:55 user nova-compute[74963]:     <system>
Nov 30 08:21:55 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:21:55 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:21:55 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:21:55 user nova-compute[74963]:       <entry name="serial">06578dba-7003-4d6f-9500-086ba85ebee6</entry>
Nov 30 08:21:55 user nova-compute[74963]:       <entry name="uuid">06578dba-7003-4d6f-9500-086ba85ebee6</entry>
Nov 30 08:21:55 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:21:55 user nova-compute[74963]:     </system>
Nov 30 08:21:55 user nova-compute[74963]:   </sysinfo>
Nov 30 08:21:55 user nova-compute[74963]:   <os>
Nov 30 08:21:55 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:21:55 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:21:55 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:21:55 user nova-compute[74963]:   </os>
Nov 30 08:21:55 user nova-compute[74963]:   <features>
Nov 30 08:21:55 user nova-compute[74963]:     <acpi/>
Nov 30 08:21:55 user nova-compute[74963]:     <apic/>
Nov 30 08:21:55 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:21:55 user nova-compute[74963]:   </features>
Nov 30 08:21:55 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:21:55 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:21:55 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:21:55 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:21:55 user nova-compute[74963]:   </clock>
Nov 30 08:21:55 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:21:55 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:21:55 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:21:55 user nova-compute[74963]:   </cpu>
Nov 30 08:21:55 user nova-compute[74963]:   <devices>
Nov 30 08:21:55 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:21:55 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:21:55 user nova-compute[74963]:       <source dev="/dev/sdg"/>
Nov 30 08:21:55 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:21:55 user nova-compute[74963]:       <serial>618fb746-5223-416c-90a6-2fe2225c714a</serial>
Nov 30 08:21:55 user nova-compute[74963]:     </disk>
Nov 30 08:21:55 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:21:55 user nova-compute[74963]:       <mac address="fa:16:3e:fd:07:35"/>
Nov 30 08:21:55 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:21:55 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:21:55 user nova-compute[74963]:       <target dev="tap355e7ed6-0e"/>
Nov 30 08:21:55 user nova-compute[74963]:     </interface>
Nov 30 08:21:55 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:21:55 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/06578dba-7003-4d6f-9500-086ba85ebee6/console.log" append="off"/>
Nov 30 08:21:55 user nova-compute[74963]:     </serial>
Nov 30 08:21:55 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:21:55 user nova-compute[74963]:     <video>
Nov 30 08:21:55 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:21:55 user nova-compute[74963]:     </video>
Nov 30 08:21:55 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:21:55 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:21:55 user nova-compute[74963]:     </rng>
Nov 30 08:21:55 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:21:55 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:21:55 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:21:55 user nova-compute[74963]:     </memballoon>
Nov 30 08:21:55 user nova-compute[74963]:   </devices>
Nov 30 08:21:55 user nova-compute[74963]: </domain>
Nov 30 08:21:55 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1978623399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1978623399',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPo15KF1HXLEyPpa+4O3PhxaN/ETMyQMGcI46Pp8izb9WazA93d3bhxCfOy90R6rUR5VCwbkC4GFrn21BszijXxqyFgAYkvjek38GdhPOnd1W1Jq/0lAq/720Jrz55UsQ==',key_name='tempest-keypair-765355062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c77b6f8fefeb4df5b8da6752ae8d0a90',ramdisk_id='',reservation_id='r-8gmjeasr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1218377200',owner_user_name='tempest-ServerActionsV293TestJSON-1218377200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38459c26cb7c4d229c2d9bdbfed447cb',uuid=06578dba-7003-4d6f-9500-086ba85ebee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converting VIF {"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG os_vif [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee087109-2a79-510a-ba5a-3e57fa7e5a83', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap355e7ed6-0e, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap355e7ed6-0e, col_values=(('qos', UUID('1e5c8f28-a9b1-4be5-a2d0-c981477c2f46')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap355e7ed6-0e, col_values=(('external_ids', {'iface-id': '355e7ed6-0e7a-430c-8d27-78f8c9bffbfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:07:35', 'vm-uuid': '06578dba-7003-4d6f-9500-086ba85ebee6'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: INFO os_vif [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e')
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] No VIF found with MAC fa:16:3e:fd:07:35, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3515cf0c-982c-4595-8238-445ed2232e01 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating instance_info_cache with network_info: [{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3515cf0c-982c-4595-8238-445ed2232e01 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Releasing lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG nova.objects.instance [None req-3515cf0c-982c-4595-8238-445ed2232e01 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'flavor' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-a12cd3d8-b65e-4bd8-ad5c-5b4b72e20150 req-73223edc-d427-436f-b19a-9465a17802be service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-unplugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a12cd3d8-b65e-4bd8-ad5c-5b4b72e20150 req-73223edc-d427-436f-b19a-9465a17802be service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a12cd3d8-b65e-4bd8-ad5c-5b4b72e20150 req-73223edc-d427-436f-b19a-9465a17802be service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a12cd3d8-b65e-4bd8-ad5c-5b4b72e20150 req-73223edc-d427-436f-b19a-9465a17802be service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-a12cd3d8-b65e-4bd8-ad5c-5b4b72e20150 req-73223edc-d427-436f-b19a-9465a17802be service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-unplugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:56 user nova-compute[74963]: WARNING nova.compute.manager [req-a12cd3d8-b65e-4bd8-ad5c-5b4b72e20150 req-73223edc-d427-436f-b19a-9465a17802be service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-unplugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:21:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-4ffcbad1-9f3b-44e5-b44c-55f449a4270b req-5f169ee5-107d-475c-ae48-174d77daca5c service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-changed-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-4ffcbad1-9f3b-44e5-b44c-55f449a4270b req-5f169ee5-107d-475c-ae48-174d77daca5c service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Refreshing instance network info cache due to event network-changed-f76abde2-a558-4cba-a95d-959ac47f8746. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4ffcbad1-9f3b-44e5-b44c-55f449a4270b req-5f169ee5-107d-475c-ae48-174d77daca5c service nova] Acquiring lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4ffcbad1-9f3b-44e5-b44c-55f449a4270b req-5f169ee5-107d-475c-ae48-174d77daca5c service nova] Acquired lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG nova.network.neutron [req-4ffcbad1-9f3b-44e5-b44c-55f449a4270b req-5f169ee5-107d-475c-ae48-174d77daca5c service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Refreshing network info cache for port f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG nova.network.neutron [req-4ffcbad1-9f3b-44e5-b44c-55f449a4270b req-5f169ee5-107d-475c-ae48-174d77daca5c service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updated VIF entry in instance network info cache for port f76abde2-a558-4cba-a95d-959ac47f8746. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG nova.network.neutron [req-4ffcbad1-9f3b-44e5-b44c-55f449a4270b req-5f169ee5-107d-475c-ae48-174d77daca5c service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating instance_info_cache with network_info: [{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:21:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4ffcbad1-9f3b-44e5-b44c-55f449a4270b req-5f169ee5-107d-475c-ae48-174d77daca5c service nova] Releasing lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:21:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Instance destroyed successfully.
Nov 30 08:21:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-71de584f-998d-4b0a-b8d8-113a947ca783 req-a0b8e479-02a6-4d02-aae3-ae447b212cba service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-71de584f-998d-4b0a-b8d8-113a947ca783 req-a0b8e479-02a6-4d02-aae3-ae447b212cba service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-71de584f-998d-4b0a-b8d8-113a947ca783 req-a0b8e479-02a6-4d02-aae3-ae447b212cba service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-71de584f-998d-4b0a-b8d8-113a947ca783 req-a0b8e479-02a6-4d02-aae3-ae447b212cba service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-71de584f-998d-4b0a-b8d8-113a947ca783 req-a0b8e479-02a6-4d02-aae3-ae447b212cba service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:58 user nova-compute[74963]: WARNING nova.compute.manager [req-71de584f-998d-4b0a-b8d8-113a947ca783 req-a0b8e479-02a6-4d02-aae3-ae447b212cba service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-changed-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Refreshing instance network info cache due to event network-changed-f76abde2-a558-4cba-a95d-959ac47f8746. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] Acquiring lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] Acquired lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.network.neutron [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Refreshing network info cache for port f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.network.neutron [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updated VIF entry in instance network info cache for port f76abde2-a558-4cba-a95d-959ac47f8746. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.network.neutron [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating instance_info_cache with network_info: [{"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] Releasing lock "refresh_cache-1528211a-3b92-46aa-8512-5c2568f361ea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] No waiting events found dispatching network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:58 user nova-compute[74963]: WARNING nova.compute.manager [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received unexpected event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd for instance with vm_state building and task_state spawning.
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:21:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] No waiting events found dispatching network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:21:58 user nova-compute[74963]: WARNING nova.compute.manager [req-e2d6d035-df73-4c50-9b46-cad30b6c08f9 req-77c61b01-bc8f-4c79-ace1-6baab690fe4b service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received unexpected event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd for instance with vm_state building and task_state spawning.
Nov 30 08:21:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:21:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:22:00 user nova-compute[74963]: WARNING nova.compute.manager [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:22:00 user nova-compute[74963]: WARNING nova.compute.manager [req-b70e7c94-8fca-420a-9251-e3a758dc2f25 req-3f9d2592-e11c-4967-9424-779fe915c330 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:22:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:22:00 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance spawned successfully.
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:22:00 user nova-compute[74963]: INFO nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Took 6.77 seconds to spawn the instance on the hypervisor.
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:22:00 user nova-compute[74963]: INFO nova.compute.manager [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Took 17.46 seconds to build instance.
Nov 30 08:22:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe90ca5e-0dcc-4e45-8462-227c9e9634f8 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "06578dba-7003-4d6f-9500-086ba85ebee6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.568s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3515cf0c-982c-4595-8238-445ed2232e01 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:22:03 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:08 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:08 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:09 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:22:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 is timed out.
Nov 30 08:22:12 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully detached device vdb from instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 from the live domain config.
Nov 30 08:22:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUanhIZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:22:12 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e9c9b1-5286-40f5-80ab-f9bb50b55404]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0984eb9-e6f5-4269-ae65-d0e186ba2892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27358ab6-e970-4826-8051-2f81e07150fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:22:12 user nova-compute[74963]: No targets found.
Nov 30 08:22:12 user nova-compute[74963]: iSNS:
Nov 30 08:22:12 user nova-compute[74963]: No targets found.
Nov 30 08:22:12 user nova-compute[74963]: STATIC:
Nov 30 08:22:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:22:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771
Nov 30 08:22:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e0984eb9-e6f5-4269-ae65-d0e186ba2892
Nov 30 08:22:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750
Nov 30 08:22:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a
Nov 30 08:22:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:27358ab6-e970-4826-8051-2f81e07150fc
Nov 30 08:22:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:22:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:22:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:12 user nova-compute[74963]: FIRMWARE:
Nov 30 08:22:12 user nova-compute[74963]: No targets found.
Nov 30 08:22:12 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:22:12 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:22:12 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4884fc4-9285-4788-ba5e-92061ce9d56b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27358ab6-e970-4826-8051-2f81e07150fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0984eb9-e6f5-4269-ae65-d0e186ba2892\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d63f17-f09b-4dd4-b99b-755e0e8545f3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27358ab6-e970-4826-8051-2f81e07150fc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0984eb9-e6f5-4269-ae65-d0e186ba2892 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27358ab6-e970-4826-8051-2f81e07150fc (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0984eb9-e6f5-4269-ae65-d0e186ba2892 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27358ab6-e970-4826-8051-2f81e07150fc (non-flash)
Nov 30 08:22:12 user nova-compute[74963]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0984eb9-e6f5-4269-ae65-d0e186ba2892 (non-flash)
Nov 30 08:22:12 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244389090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771'): ({'sdf'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Removing single pathed devices sdf {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4845c788-cb0d-4ae9-9a42-5fa24295b1e8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafb83cb-ba7f-4196-8b2c-5d8027683c44]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flushing IO for device /dev/sdf {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a744bd8-0ab6-421e-a8a5-091b43145289]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cc370f-3da2-4e36-ade2-9ee5872a73e8]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] SCSI volumes sdf have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c075d13-4d2c-42f2-859c-615c1007d1ad]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[98838ba9-1282-4c26-8740-2f56fb9f7f58]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260]
Nov 30 08:22:12 user nova-compute[74963]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771, portal: 172.16.0.220,3260] successful.
Nov 30 08:22:12 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d1e2f3-3675-4fcd-9bf5-771135fca771 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f801ca8-719f-49ba-bc8d-63821eb4bee7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== disconnect_volume: return (454ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:13 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:22:13 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7668MB free_disk=24.94890594482422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.objects.instance [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-85254538-c337-4a38-a088-2b39f6ba7643 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.164s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1528211a-3b92-46aa-8512-5c2568f361ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 06578dba-7003-4d6f-9500-086ba85ebee6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing inventories for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating ProviderTree inventory for provider 41961ac9-576a-4a02-a5e7-459f54657b3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 08:22:13 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating inventory in ProviderTree for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing aggregate associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, aggregates: None {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing trait associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.963s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74963) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-698207cc-fd58-4f2f-8294-2c50bd7d2d93 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-698207cc-fd58-4f2f-8294-2c50bd7d2d93 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-698207cc-fd58-4f2f-8294-2c50bd7d2d93 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-698207cc-fd58-4f2f-8294-2c50bd7d2d93 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74963) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.objects.instance [None req-698207cc-fd58-4f2f-8294-2c50bd7d2d93 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-f758f4f2-6e4b-41df-9a0f-919b0f586d2f req-dea58325-3ec3-4585-8ce2-ae13983b3a97 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-unplugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f758f4f2-6e4b-41df-9a0f-919b0f586d2f req-dea58325-3ec3-4585-8ce2-ae13983b3a97 service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f758f4f2-6e4b-41df-9a0f-919b0f586d2f req-dea58325-3ec3-4585-8ce2-ae13983b3a97 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f758f4f2-6e4b-41df-9a0f-919b0f586d2f req-dea58325-3ec3-4585-8ce2-ae13983b3a97 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-f758f4f2-6e4b-41df-9a0f-919b0f586d2f req-dea58325-3ec3-4585-8ce2-ae13983b3a97 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-unplugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:22:14 user nova-compute[74963]: WARNING nova.compute.manager [req-f758f4f2-6e4b-41df-9a0f-919b0f586d2f req-dea58325-3ec3-4585-8ce2-ae13983b3a97 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-unplugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state active and task_state powering-off.
Nov 30 08:22:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance destroyed successfully.
Nov 30 08:22:15 user nova-compute[74963]: DEBUG nova.compute.manager [None req-698207cc-fd58-4f2f-8294-2c50bd7d2d93 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:22:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-698207cc-fd58-4f2f-8294-2c50bd7d2d93 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.899s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-434b60a4-ba05-4eb2-9449-885fa2a769dc req-7f1d8ea9-8b66-474f-9fa9-742f7164e5db service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-434b60a4-ba05-4eb2-9449-885fa2a769dc req-7f1d8ea9-8b66-474f-9fa9-742f7164e5db service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-434b60a4-ba05-4eb2-9449-885fa2a769dc req-7f1d8ea9-8b66-474f-9fa9-742f7164e5db service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-434b60a4-ba05-4eb2-9449-885fa2a769dc req-7f1d8ea9-8b66-474f-9fa9-742f7164e5db service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-434b60a4-ba05-4eb2-9449-885fa2a769dc req-7f1d8ea9-8b66-474f-9fa9-742f7164e5db service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:22:16 user nova-compute[74963]: WARNING nova.compute.manager [req-434b60a4-ba05-4eb2-9449-885fa2a769dc req-7f1d8ea9-8b66-474f-9fa9-742f7164e5db service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state stopped and task_state None.
Nov 30 08:22:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updating instance_info_cache with network_info: [{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:22:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:22:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:22:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:22:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 08:22:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] There are 0 instances to clean {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 08:22:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:28 user nova-compute[74963]: INFO nova.compute.manager [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Detaching volume de544a0f-7e9e-41f7-8706-c2402010a750
Nov 30 08:22:28 user nova-compute[74963]: INFO nova.virt.block_device [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Attempting to driver detach volume de544a0f-7e9e-41f7-8706-c2402010a750 from mountpoint /dev/vdb
Nov 30 08:22:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Attempting to detach device vdb from instance 1528211a-3b92-46aa-8512-5c2568f361ea from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:22:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:22:28 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:22:28 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:22:28 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:22:28 user nova-compute[74963]:   <serial>de544a0f-7e9e-41f7-8706-c2402010a750</serial>
Nov 30 08:22:28 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:22:28 user nova-compute[74963]: </disk>
Nov 30 08:22:28 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:22:28 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Successfully detached device vdb from instance 1528211a-3b92-46aa-8512-5c2568f361ea from the persistent domain config.
Nov 30 08:22:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1528211a-3b92-46aa-8512-5c2568f361ea from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:22:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:22:28 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:22:28 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:22:28 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:22:28 user nova-compute[74963]:   <serial>de544a0f-7e9e-41f7-8706-c2402010a750</serial>
Nov 30 08:22:28 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:22:28 user nova-compute[74963]: </disk>
Nov 30 08:22:28 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:22:28 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:22:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 68bcb314-8197-4fe6-b986-b2554c822545 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 9feae61e-e897-4fa0-b534-157153e8f6c3 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 06578dba-7003-4d6f-9500-086ba85ebee6 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "68bcb314-8197-4fe6-b986-b2554c822545" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "68bcb314-8197-4fe6-b986-b2554c822545" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "db76a4e1-46a1-4349-a21f-34d43d542349" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "9feae61e-e897-4fa0-b534-157153e8f6c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "06578dba-7003-4d6f-9500-086ba85ebee6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "db76a4e1-46a1-4349-a21f-34d43d542349" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "68bcb314-8197-4fe6-b986-b2554c822545" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "06578dba-7003-4d6f-9500-086ba85ebee6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:22:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:22:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:44 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:22:44 user nova-compute[74963]: INFO nova.compute.claims [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Claim successful on node user
Nov 30 08:22:45 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG nova.network.neutron [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:22:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:22:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:22:45 user nova-compute[74963]: INFO nova.virt.block_device [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Booting with volume 1ad36f73-d092-4acf-aac7-0969e77ebeb7 at /dev/vda
Nov 30 08:22:45 user nova-compute[74963]: DEBUG nova.policy [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c803479aa87e4be79682975d47b7ccfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22db86fd7a54c5c9882623605de5608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG os_brick.utils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[258b86db-ce83-4636-b400-87754d5d8617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de92a91b-1710-4568-93f8-2a1681d6c97a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b28307-1ba1-44fe-a606-b6c11293cf44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63c866a-9aaa-4d2e-9a82-ee936d4132e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:22:45 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:22:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be7d749-03ce-456e-bcc9-cee0c4e6156a]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG os_brick.utils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:22:45 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating existing volume attachment record: d3a12402-b2ca-4e0f-8d99-ce059ee18f46 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:22:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:46 user nova-compute[74963]: DEBUG nova.network.neutron [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Successfully created port: 235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.network.neutron [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Successfully updated port: 235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquired lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.network.neutron [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-9fa4b9e5-7117-4fe6-a28a-ef471b024516 req-9b288519-a28c-44ad-95c8-1c32feed1c60 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-changed-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-9fa4b9e5-7117-4fe6-a28a-ef471b024516 req-9b288519-a28c-44ad-95c8-1c32feed1c60 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Refreshing instance network info cache due to event network-changed-235245f2-5cdc-4b02-8941-beafefbcd5e2. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9fa4b9e5-7117-4fe6-a28a-ef471b024516 req-9b288519-a28c-44ad-95c8-1c32feed1c60 service nova] Acquiring lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.network.neutron [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.network.neutron [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating instance_info_cache with network_info: [{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Releasing lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Instance network_info: |[{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9fa4b9e5-7117-4fe6-a28a-ef471b024516 req-9b288519-a28c-44ad-95c8-1c32feed1c60 service nova] Acquired lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.network.neutron [req-9fa4b9e5-7117-4fe6-a28a-ef471b024516 req-9b288519-a28c-44ad-95c8-1c32feed1c60 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Refreshing network info cache for port 235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.network.neutron [req-9fa4b9e5-7117-4fe6-a28a-ef471b024516 req-9b288519-a28c-44ad-95c8-1c32feed1c60 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updated VIF entry in instance network info cache for port 235245f2-5cdc-4b02-8941-beafefbcd5e2. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG nova.network.neutron [req-9fa4b9e5-7117-4fe6-a28a-ef471b024516 req-9b288519-a28c-44ad-95c8-1c32feed1c60 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating instance_info_cache with network_info: [{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:22:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9fa4b9e5-7117-4fe6-a28a-ef471b024516 req-9b288519-a28c-44ad-95c8-1c32feed1c60 service nova] Releasing lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:22:48 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1528211a-3b92-46aa-8512-5c2568f361ea is timed out.
Nov 30 08:22:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Successfully detached device vdb from instance 1528211a-3b92-46aa-8512-5c2568f361ea from the live domain config.
Nov 30 08:22:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbnTeIkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:22:48 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ebd882-c981-461d-ba68-220f1d7972ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:22:48 user nova-compute[74963]: No targets found.
Nov 30 08:22:48 user nova-compute[74963]: iSNS:
Nov 30 08:22:48 user nova-compute[74963]: No targets found.
Nov 30 08:22:48 user nova-compute[74963]: STATIC:
Nov 30 08:22:48 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:22:48 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:48 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:48 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750
Nov 30 08:22:48 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:48 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:48 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a
Nov 30 08:22:48 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:48 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:48 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:22:48 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:48 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:48 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:22:48 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:22:48 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:22:48 user nova-compute[74963]: FIRMWARE:
Nov 30 08:22:48 user nova-compute[74963]: No targets found.
Nov 30 08:22:48 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:22:48 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:22:48 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[afebf381-7254-4ae5-a8b3-8d1c3645177c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02d04c6-6c1d-4e5b-9c6e-59b18abd0eb4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:22:48 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:22:48 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:22:48 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:22:48 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:22:48 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:22:48 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:22:48 user nova-compute[74963]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 (non-flash)
Nov 30 08:22:48 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:22:48 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:22:48 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62444a1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750'): ({'sde'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Removing single pathed devices sde {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f510eb-5cff-426d-a8f8-1022b2c10781]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca930a4-29ff-4610-b50b-299181d71d6b]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Flushing IO for device /dev/sde {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3361a8-3af0-4689-980d-509dfaddbfaa]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb70e83-c6c5-4c7e-85b9-1be908981d01]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f98653-2232-4c0b-84ca-119bf7404854]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ed7517-8d2e-4078-8ecb-61d3356e93a2]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750, portal: 172.16.0.220,3260]
Nov 30 08:22:48 user nova-compute[74963]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750, portal: 172.16.0.220,3260] successful.
Nov 30 08:22:48 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de544a0f-7e9e-41f7-8706-c2402010a750 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e59c7ad-ee7e-4a04-8d01-12de39e8e83c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] <== disconnect_volume: return (336ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:22:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:22:49 user nova-compute[74963]: DEBUG nova.objects.instance [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'flavor' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:22:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-acbfaf2d-518c-4736-a1b2-33ebafef0356 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.376s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:22:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:22:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:22:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:23:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:23:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:23:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:23:02 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Creating image(s)
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Ensure instance console log exists: /opt/stack/data/nova/instances/4b7e702a-7148-4e96-bf46-9fe600dc5dce/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Start _get_guest_xml network_info=[{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZniHaxqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b7e702a-7148-4e96-bf46-9fe600dc5dce', 'attached_at': '', 'detached_at': '', 'volume_id': '1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'serial': '1ad36f73-d092-4acf-aac7-0969e77ebeb7'}, 'attachment_id': 'd3a12402-b2ca-4e0f-8d99-ce059ee18f46', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:23:02 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:23:02 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZniHaxqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:23:02 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:23:02 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:23:02 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae737b4-c419-4b82-88a8-5756310780c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:23:02 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ce0ed4-bf5c-4c18-8114-96f1c33ba1a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7] added
Nov 30 08:23:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a41b5-7739-40d7-a4cc-75a54480a1e7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38e0476-89a8-4feb-a312-9ba63729782a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZniHaxqo {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZniHaxqo" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b784f-0ec8-42f9-a22d-bc41f012aba9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZniHaxqo'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ece4bde-bf11-4ef0-8364-7d356663aef5]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51ed5a7-49bc-4be5-bc6e-03391a77ffcd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:23:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:23:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc90c5f2-e254-4452-97bf-3bc6463407cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260]
Nov 30 08:23:02 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260] successful.
Nov 30 08:23:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d357f7-7fbb-4d7d-8f67-3112d532bbbf]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e747497-57e5-4061-ab77-6921dadddba9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:23:02 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:23:02 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411da81-58c4-4068-a992-a115f7a25c6b]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:23:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZniHaxqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23938333063613337', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938333063613337', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-458762508',display_name='tempest-ServerActionsTestOtherA-server-458762508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-458762508',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsWMnq1ufqR++qStn5b43QWm222qTuytohSz8l1/sudpdFVTZkwiTwMp7sHBCXTNfQV4IhtlWVxhMZmDIqgf0oPJwcUspQxqKKVyuXcOkB5qHVJX6ziQnRILaSQcb0Pg==',key_name='tempest-keypair-537501141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-m1zjngta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=4b7e702a-7148-4e96-bf46-9fe600dc5dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.objects.instance [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b7e702a-7148-4e96-bf46-9fe600dc5dce {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:23:03 user nova-compute[74963]:   <uuid>4b7e702a-7148-4e96-bf46-9fe600dc5dce</uuid>
Nov 30 08:23:03 user nova-compute[74963]:   <name>instance-0000001d</name>
Nov 30 08:23:03 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:23:03 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:23:03 user nova-compute[74963]:   <metadata>
Nov 30 08:23:03 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:23:03 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:23:03 user nova-compute[74963]:       <nova:name>tempest-ServerActionsTestOtherA-server-458762508</nova:name>
Nov 30 08:23:03 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:23:02</nova:creationTime>
Nov 30 08:23:03 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:23:03 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:23:03 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:23:03 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:23:03 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:23:03 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:23:03 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:23:03 user nova-compute[74963]:       <nova:owner>
Nov 30 08:23:03 user nova-compute[74963]:         <nova:user uuid="c803479aa87e4be79682975d47b7ccfd">tempest-ServerActionsTestOtherA-768867057-project-member</nova:user>
Nov 30 08:23:03 user nova-compute[74963]:         <nova:project uuid="e22db86fd7a54c5c9882623605de5608">tempest-ServerActionsTestOtherA-768867057</nova:project>
Nov 30 08:23:03 user nova-compute[74963]:       </nova:owner>
Nov 30 08:23:03 user nova-compute[74963]:       <nova:ports>
Nov 30 08:23:03 user nova-compute[74963]:         <nova:port uuid="235245f2-5cdc-4b02-8941-beafefbcd5e2">
Nov 30 08:23:03 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 08:23:03 user nova-compute[74963]:         </nova:port>
Nov 30 08:23:03 user nova-compute[74963]:       </nova:ports>
Nov 30 08:23:03 user nova-compute[74963]:     </nova:instance>
Nov 30 08:23:03 user nova-compute[74963]:   </metadata>
Nov 30 08:23:03 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:23:03 user nova-compute[74963]:     <system>
Nov 30 08:23:03 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:23:03 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:23:03 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:23:03 user nova-compute[74963]:       <entry name="serial">4b7e702a-7148-4e96-bf46-9fe600dc5dce</entry>
Nov 30 08:23:03 user nova-compute[74963]:       <entry name="uuid">4b7e702a-7148-4e96-bf46-9fe600dc5dce</entry>
Nov 30 08:23:03 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:23:03 user nova-compute[74963]:     </system>
Nov 30 08:23:03 user nova-compute[74963]:   </sysinfo>
Nov 30 08:23:03 user nova-compute[74963]:   <os>
Nov 30 08:23:03 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:23:03 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:23:03 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:23:03 user nova-compute[74963]:   </os>
Nov 30 08:23:03 user nova-compute[74963]:   <features>
Nov 30 08:23:03 user nova-compute[74963]:     <acpi/>
Nov 30 08:23:03 user nova-compute[74963]:     <apic/>
Nov 30 08:23:03 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:23:03 user nova-compute[74963]:   </features>
Nov 30 08:23:03 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:23:03 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:23:03 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:23:03 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:23:03 user nova-compute[74963]:   </clock>
Nov 30 08:23:03 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:23:03 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:23:03 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:23:03 user nova-compute[74963]:   </cpu>
Nov 30 08:23:03 user nova-compute[74963]:   <devices>
Nov 30 08:23:03 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:23:03 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:23:03 user nova-compute[74963]:       <source dev="/dev/sde"/>
Nov 30 08:23:03 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:23:03 user nova-compute[74963]:       <serial>1ad36f73-d092-4acf-aac7-0969e77ebeb7</serial>
Nov 30 08:23:03 user nova-compute[74963]:     </disk>
Nov 30 08:23:03 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:23:03 user nova-compute[74963]:       <mac address="fa:16:3e:9b:11:4a"/>
Nov 30 08:23:03 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:23:03 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:23:03 user nova-compute[74963]:       <target dev="tap235245f2-5c"/>
Nov 30 08:23:03 user nova-compute[74963]:     </interface>
Nov 30 08:23:03 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:23:03 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/4b7e702a-7148-4e96-bf46-9fe600dc5dce/console.log" append="off"/>
Nov 30 08:23:03 user nova-compute[74963]:     </serial>
Nov 30 08:23:03 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:23:03 user nova-compute[74963]:     <video>
Nov 30 08:23:03 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:23:03 user nova-compute[74963]:     </video>
Nov 30 08:23:03 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:23:03 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:23:03 user nova-compute[74963]:     </rng>
Nov 30 08:23:03 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:23:03 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:23:03 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:23:03 user nova-compute[74963]:     </memballoon>
Nov 30 08:23:03 user nova-compute[74963]:   </devices>
Nov 30 08:23:03 user nova-compute[74963]: </domain>
Nov 30 08:23:03 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-458762508',display_name='tempest-ServerActionsTestOtherA-server-458762508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-458762508',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsWMnq1ufqR++qStn5b43QWm222qTuytohSz8l1/sudpdFVTZkwiTwMp7sHBCXTNfQV4IhtlWVxhMZmDIqgf0oPJwcUspQxqKKVyuXcOkB5qHVJX6ziQnRILaSQcb0Pg==',key_name='tempest-keypair-537501141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-m1zjngta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=4b7e702a-7148-4e96-bf46-9fe600dc5dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG os_vif [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d8118d2-d8f1-5127-9ce0-73c5fdc4dc95', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap235245f2-5c, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap235245f2-5c, col_values=(('qos', UUID('17f5a6d1-360f-4e7b-9ee8-3682484ad1ca')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap235245f2-5c, col_values=(('external_ids', {'iface-id': '235245f2-5cdc-4b02-8941-beafefbcd5e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:11:4a', 'vm-uuid': '4b7e702a-7148-4e96-bf46-9fe600dc5dce'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:03 user nova-compute[74963]: INFO os_vif [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c')
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:23:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No VIF found with MAC fa:16:3e:9b:11:4a, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-85f0f7f5-b5ba-48be-93d2-31726d6c76e7 req-8598d2a7-b84b-4557-ba38-e80506a74ba1 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-85f0f7f5-b5ba-48be-93d2-31726d6c76e7 req-8598d2a7-b84b-4557-ba38-e80506a74ba1 service nova] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-85f0f7f5-b5ba-48be-93d2-31726d6c76e7 req-8598d2a7-b84b-4557-ba38-e80506a74ba1 service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-85f0f7f5-b5ba-48be-93d2-31726d6c76e7 req-8598d2a7-b84b-4557-ba38-e80506a74ba1 service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-85f0f7f5-b5ba-48be-93d2-31726d6c76e7 req-8598d2a7-b84b-4557-ba38-e80506a74ba1 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] No waiting events found dispatching network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:05 user nova-compute[74963]: WARNING nova.compute.manager [req-85f0f7f5-b5ba-48be-93d2-31726d6c76e7 req-8598d2a7-b84b-4557-ba38-e80506a74ba1 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received unexpected event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 for instance with vm_state building and task_state spawning.
Nov 30 08:23:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:23:07 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Instance spawned successfully.
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:23:07 user nova-compute[74963]: INFO nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-b2f861a1-3de1-42f7-841b-8a47fae29740 req-3c3393db-0b2a-4aa3-96a2-15e6ffc589c8 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b2f861a1-3de1-42f7-841b-8a47fae29740 req-3c3393db-0b2a-4aa3-96a2-15e6ffc589c8 service nova] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b2f861a1-3de1-42f7-841b-8a47fae29740 req-3c3393db-0b2a-4aa3-96a2-15e6ffc589c8 service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b2f861a1-3de1-42f7-841b-8a47fae29740 req-3c3393db-0b2a-4aa3-96a2-15e6ffc589c8 service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-b2f861a1-3de1-42f7-841b-8a47fae29740 req-3c3393db-0b2a-4aa3-96a2-15e6ffc589c8 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] No waiting events found dispatching network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:07 user nova-compute[74963]: WARNING nova.compute.manager [req-b2f861a1-3de1-42f7-841b-8a47fae29740 req-3c3393db-0b2a-4aa3-96a2-15e6ffc589c8 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received unexpected event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 for instance with vm_state building and task_state spawning.
Nov 30 08:23:07 user nova-compute[74963]: INFO nova.compute.manager [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Took 22.56 seconds to build instance.
Nov 30 08:23:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-80dfd9eb-e5f6-44b9-985b-8a083e4fd98a tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.664s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:09 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:23:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:23:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:23:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:12 user nova-compute[74963]: INFO nova.compute.manager [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Terminating instance
Nov 30 08:23:12 user nova-compute[74963]: DEBUG nova.compute.manager [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-21ec9773-fb6d-4d56-9c53-17b16e6b9d9a req-b96989f7-be32-4876-86db-d10d5d17147f service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-unplugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-21ec9773-fb6d-4d56-9c53-17b16e6b9d9a req-b96989f7-be32-4876-86db-d10d5d17147f service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-21ec9773-fb6d-4d56-9c53-17b16e6b9d9a req-b96989f7-be32-4876-86db-d10d5d17147f service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-21ec9773-fb6d-4d56-9c53-17b16e6b9d9a req-b96989f7-be32-4876-86db-d10d5d17147f service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-21ec9773-fb6d-4d56-9c53-17b16e6b9d9a req-b96989f7-be32-4876-86db-d10d5d17147f service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-unplugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-21ec9773-fb6d-4d56-9c53-17b16e6b9d9a req-b96989f7-be32-4876-86db-d10d5d17147f service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-unplugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Instance destroyed successfully.
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.objects.instance [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'resources' on Instance uuid 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1543762884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1543762884',id=25,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:19:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-ksav8sxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:21:26Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=38b0d9d9-9a05-44e3-bdd1-ac6da28204fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "address": "fa:16:3e:09:5d:bb", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd435ad-5e", "ovs_interfaceid": "8bd435ad-5e5a-45c7-8282-3819f0935b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=8bd435ad-5e5a-45c7-8282-3819f0935b25,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd435ad-5e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_vif [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=8bd435ad-5e5a-45c7-8282-3819f0935b25,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd435ad-5e') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bd435ad-5e, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3eefdee-4022-4e23-97db-59996f294d34) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:13 user nova-compute[74963]: INFO os_vif [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=8bd435ad-5e5a-45c7-8282-3819f0935b25,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd435ad-5e')
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJSQtNZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:23:13 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e27dc-cde4-458b-9ddf-3ee66fe26eb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:23:13 user nova-compute[74963]: No targets found.
Nov 30 08:23:13 user nova-compute[74963]: iSNS:
Nov 30 08:23:13 user nova-compute[74963]: No targets found.
Nov 30 08:23:13 user nova-compute[74963]: STATIC:
Nov 30 08:23:13 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4
Nov 30 08:23:13 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:13 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:13 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a
Nov 30 08:23:13 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:13 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:13 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7
Nov 30 08:23:13 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:13 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:13 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:23:13 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:13 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:13 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:23:13 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:13 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:13 user nova-compute[74963]: FIRMWARE:
Nov 30 08:23:13 user nova-compute[74963]: No targets found.
Nov 30 08:23:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:23:13 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:23:13 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7872a58d-c1da-4bc1-ba4b-23cf851e94d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4da4a1-edfa-49c9-a8ef-617a61d9b30d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:13 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:23:13 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:13 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:23:13 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:23:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:13 user nova-compute[74963]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 (non-flash)
Nov 30 08:23:13 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:13 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:23:13 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:23:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244729900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4'): ({'sdc'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Removing single pathed devices sdc {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b413153-5dd8-4e45-8754-2d5bb20dc0fb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ec1d57-8378-454c-923c-e294c7ec4cb1]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flushing IO for device /dev/sdc {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95be07d-517e-4f44-8a06-487e9a27170c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.069s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65be52f-1af2-4fb6-8ccd-79c169d9a407]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9acf945-239b-4a00-b329-797e75139837]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c03468-8a74-469b-befb-58f182681c28]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4, portal: 172.16.0.220,3260]
Nov 30 08:23:13 user nova-compute[74963]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4, portal: 172.16.0.220,3260] successful.
Nov 30 08:23:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e22766fe-5c2c-49af-86b6-ec8686d31eb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[254d8d58-efe2-4bb1-a5c4-15dbbfc35865]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] <== disconnect_volume: return (401ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:23:13 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Deleting instance files /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe_del
Nov 30 08:23:13 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Deletion of /opt/stack/data/nova/instances/38b0d9d9-9a05-44e3-bdd1-ac6da28204fe_del complete
Nov 30 08:23:13 user nova-compute[74963]: INFO nova.compute.manager [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:23:14 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Took 0.59 seconds to deallocate network for instance.
Nov 30 08:23:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-277779ea-652c-4cea-b97a-c994136f261b req-8dc983a2-a261-464b-9b0d-69030feb03a9 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-deleted-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:14 user nova-compute[74963]: INFO nova.compute.manager [req-277779ea-652c-4cea-b97a-c994136f261b req-8dc983a2-a261-464b-9b0d-69030feb03a9 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Neutron deleted interface 8bd435ad-5e5a-45c7-8282-3819f0935b25; detaching it from the instance and deleting it from the info cache
Nov 30 08:23:14 user nova-compute[74963]: DEBUG nova.network.neutron [req-277779ea-652c-4cea-b97a-c994136f261b req-8dc983a2-a261-464b-9b0d-69030feb03a9 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-277779ea-652c-4cea-b97a-c994136f261b req-8dc983a2-a261-464b-9b0d-69030feb03a9 service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Detach interface failed, port_id=8bd435ad-5e5a-45c7-8282-3819f0935b25, reason: Instance 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-e140b06a-0679-4c3c-9585-e42e1e9072e3 req-470cefa6-f2f8-4adf-af0b-ee379d302cbf service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e140b06a-0679-4c3c-9585-e42e1e9072e3 req-470cefa6-f2f8-4adf-af0b-ee379d302cbf service nova] Acquiring lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e140b06a-0679-4c3c-9585-e42e1e9072e3 req-470cefa6-f2f8-4adf-af0b-ee379d302cbf service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e140b06a-0679-4c3c-9585-e42e1e9072e3 req-470cefa6-f2f8-4adf-af0b-ee379d302cbf service nova] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-e140b06a-0679-4c3c-9585-e42e1e9072e3 req-470cefa6-f2f8-4adf-af0b-ee379d302cbf service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] No waiting events found dispatching network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:14 user nova-compute[74963]: WARNING nova.compute.manager [req-e140b06a-0679-4c3c-9585-e42e1e9072e3 req-470cefa6-f2f8-4adf-af0b-ee379d302cbf service nova] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Received unexpected event network-vif-plugged-8bd435ad-5e5a-45c7-8282-3819f0935b25 for instance with vm_state active and task_state deleting.
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:15 user nova-compute[74963]: INFO nova.compute.manager [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe] Took 1.15 seconds to detach 1 volumes for instance.
Nov 30 08:23:15 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:23:15 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7794MB free_disk=24.9378662109375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1528211a-3b92-46aa-8512-5c2568f361ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 06578dba-7003-4d6f-9500-086ba85ebee6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.461s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:16 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:23:16 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:23:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:16 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Deleted allocations for instance 38b0d9d9-9a05-44e3-bdd1-ac6da28204fe
Nov 30 08:23:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-22ed58a8-384a-41d0-ae96-f3c43959bb30 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "38b0d9d9-9a05-44e3-bdd1-ac6da28204fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.189s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:23:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:23:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:23:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:23:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:23:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:23:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updating instance_info_cache with network_info: [{"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:23:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-e4386623-a0b7-4145-8b84-2a7b64c3a98f" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:23:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:23:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:23:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:23:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:23:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:18 user nova-compute[74963]: INFO nova.compute.manager [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Terminating instance
Nov 30 08:23:18 user nova-compute[74963]: DEBUG nova.compute.manager [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-9ead5459-20e4-45a9-8185-fbf04f31d4b6 req-87f350a1-76c3-4c0d-bbc7-01d43f476aff service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-unplugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9ead5459-20e4-45a9-8185-fbf04f31d4b6 req-87f350a1-76c3-4c0d-bbc7-01d43f476aff service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9ead5459-20e4-45a9-8185-fbf04f31d4b6 req-87f350a1-76c3-4c0d-bbc7-01d43f476aff service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9ead5459-20e4-45a9-8185-fbf04f31d4b6 req-87f350a1-76c3-4c0d-bbc7-01d43f476aff service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-9ead5459-20e4-45a9-8185-fbf04f31d4b6 req-87f350a1-76c3-4c0d-bbc7-01d43f476aff service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-unplugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-9ead5459-20e4-45a9-8185-fbf04f31d4b6 req-87f350a1-76c3-4c0d-bbc7-01d43f476aff service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-unplugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:23:19 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Instance destroyed successfully.
Nov 30 08:23:19 user nova-compute[74963]: DEBUG nova.objects.instance [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lazy-loading 'resources' on Instance uuid 1528211a-3b92-46aa-8512-5c2568f361ea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-276068840',display_name='tempest-ServerStableDeviceRescueTest-server-276068840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-276068840',id=23,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE40jvwvsDQoaQ3t8TBNrzK6XW0OcvTn7nok9F/lP8HPBvrXhsdZBe+FtRUWZI/eJhWClnJvORdzk45IuI0V2vZfiANVF9lPL6ESNpM6LHAjFUbsb0BnY1YF/tvKV3F7SA==',key_name='tempest-keypair-1057764945',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='013793585eb2493d80b2bd27e64c4471',ramdisk_id='',reservation_id='r-x2r2tcfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1608184284',owner_user_name='tempest-ServerStableDeviceRescueTest-1608184284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:22:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f051de260047f8af5e1cc872e4ae80',uuid=1528211a-3b92-46aa-8512-5c2568f361ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Converting VIF {"id": "f76abde2-a558-4cba-a95d-959ac47f8746", "address": "fa:16:3e:ed:d5:1c", "network": {"id": "3070ea18-ada1-4d74-bf4f-9d95958aec61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2112460398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "013793585eb2493d80b2bd27e64c4471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76abde2-a5", "ovs_interfaceid": "f76abde2-a558-4cba-a95d-959ac47f8746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d5:1c,bridge_name='br-int',has_traffic_filtering=True,id=f76abde2-a558-4cba-a95d-959ac47f8746,network=Network(3070ea18-ada1-4d74-bf4f-9d95958aec61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76abde2-a5') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG os_vif [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d5:1c,bridge_name='br-int',has_traffic_filtering=True,id=f76abde2-a558-4cba-a95d-959ac47f8746,network=Network(3070ea18-ada1-4d74-bf4f-9d95958aec61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76abde2-a5') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf76abde2-a5, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6153de8e-85ed-4aff-bef3-9b16dcd68e55) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:19 user nova-compute[74963]: INFO os_vif [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d5:1c,bridge_name='br-int',has_traffic_filtering=True,id=f76abde2-a558-4cba-a95d-959ac47f8746,network=Network(3070ea18-ada1-4d74-bf4f-9d95958aec61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76abde2-a5')
Nov 30 08:23:19 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Deleting instance files /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea_del
Nov 30 08:23:19 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Deletion of /opt/stack/data/nova/instances/1528211a-3b92-46aa-8512-5c2568f361ea_del complete
Nov 30 08:23:19 user nova-compute[74963]: INFO nova.compute.manager [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 30 08:23:19 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:23:19 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:23:20 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:23:20 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Took 0.79 seconds to deallocate network for instance.
Nov 30 08:23:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-f2c9020d-05e4-4968-9df8-95cd272a49aa req-0cfa1c3c-3a4f-457f-a690-e329bcfbf214 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-deleted-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:20 user nova-compute[74963]: INFO nova.compute.manager [req-f2c9020d-05e4-4968-9df8-95cd272a49aa req-0cfa1c3c-3a4f-457f-a690-e329bcfbf214 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Neutron deleted interface f76abde2-a558-4cba-a95d-959ac47f8746; detaching it from the instance and deleting it from the info cache
Nov 30 08:23:20 user nova-compute[74963]: DEBUG nova.network.neutron [req-f2c9020d-05e4-4968-9df8-95cd272a49aa req-0cfa1c3c-3a4f-457f-a690-e329bcfbf214 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:23:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-f2c9020d-05e4-4968-9df8-95cd272a49aa req-0cfa1c3c-3a4f-457f-a690-e329bcfbf214 service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Detach interface failed, port_id=f76abde2-a558-4cba-a95d-959ac47f8746, reason: Instance 1528211a-3b92-46aa-8512-5c2568f361ea could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:23:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:20 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:23:20 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:23:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:21 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Deleted allocations for instance 1528211a-3b92-46aa-8512-5c2568f361ea
Nov 30 08:23:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-a11e536b-0ada-496a-b143-d7eee3233754 tempest-ServerStableDeviceRescueTest-1608184284 tempest-ServerStableDeviceRescueTest-1608184284-project-member] Lock "1528211a-3b92-46aa-8512-5c2568f361ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-871485ae-b464-43f2-95b0-a8236b92fb1f req-a51d42cb-e3d3-45de-b9ad-b7e3aeb1882f service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-871485ae-b464-43f2-95b0-a8236b92fb1f req-a51d42cb-e3d3-45de-b9ad-b7e3aeb1882f service nova] Acquiring lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-871485ae-b464-43f2-95b0-a8236b92fb1f req-a51d42cb-e3d3-45de-b9ad-b7e3aeb1882f service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-871485ae-b464-43f2-95b0-a8236b92fb1f req-a51d42cb-e3d3-45de-b9ad-b7e3aeb1882f service nova] Lock "1528211a-3b92-46aa-8512-5c2568f361ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-871485ae-b464-43f2-95b0-a8236b92fb1f req-a51d42cb-e3d3-45de-b9ad-b7e3aeb1882f service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] No waiting events found dispatching network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:21 user nova-compute[74963]: WARNING nova.compute.manager [req-871485ae-b464-43f2-95b0-a8236b92fb1f req-a51d42cb-e3d3-45de-b9ad-b7e3aeb1882f service nova] [instance: 1528211a-3b92-46aa-8512-5c2568f361ea] Received unexpected event network-vif-plugged-f76abde2-a558-4cba-a95d-959ac47f8746 for instance with vm_state deleted and task_state None.
Nov 30 08:23:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:30 user nova-compute[74963]: INFO nova.compute.manager [None req-058cb179-4a9a-4c9c-9370-14ff3230ad72 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Unrescuing
Nov 30 08:23:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-058cb179-4a9a-4c9c-9370-14ff3230ad72 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:23:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-058cb179-4a9a-4c9c-9370-14ff3230ad72 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquired lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:23:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-058cb179-4a9a-4c9c-9370-14ff3230ad72 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:23:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-058cb179-4a9a-4c9c-9370-14ff3230ad72 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updating instance_info_cache with network_info: [{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:23:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-058cb179-4a9a-4c9c-9370-14ff3230ad72 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Releasing lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:23:30 user nova-compute[74963]: DEBUG nova.objects.instance [None req-058cb179-4a9a-4c9c-9370-14ff3230ad72 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'flavor' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:23:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:31 user nova-compute[74963]: DEBUG nova.compute.manager [req-65213e4f-ae63-46ec-b378-37acb4016443 req-b1a4ebcc-d1cc-47d4-8270-e80f0ee519b6 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-unplugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-65213e4f-ae63-46ec-b378-37acb4016443 req-b1a4ebcc-d1cc-47d4-8270-e80f0ee519b6 service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-65213e4f-ae63-46ec-b378-37acb4016443 req-b1a4ebcc-d1cc-47d4-8270-e80f0ee519b6 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-65213e4f-ae63-46ec-b378-37acb4016443 req-b1a4ebcc-d1cc-47d4-8270-e80f0ee519b6 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:31 user nova-compute[74963]: DEBUG nova.compute.manager [req-65213e4f-ae63-46ec-b378-37acb4016443 req-b1a4ebcc-d1cc-47d4-8270-e80f0ee519b6 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-unplugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:31 user nova-compute[74963]: WARNING nova.compute.manager [req-65213e4f-ae63-46ec-b378-37acb4016443 req-b1a4ebcc-d1cc-47d4-8270-e80f0ee519b6 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-unplugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:23:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:31 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Instance destroyed successfully.
Nov 30 08:23:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:33 user nova-compute[74963]: WARNING nova.compute.manager [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:23:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:33 user nova-compute[74963]: WARNING nova.compute.manager [req-5c026dc6-9508-4b7b-a56b-f982be8d1b44 req-7c6d8de7-fab7-4b96-a47e-a6de4554a729 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state rescued and task_state unrescuing.
Nov 30 08:23:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-9ab81a70-9965-41de-8927-c4126ef661ab req-28a19259-f44c-4f5b-b95e-049bd80834c5 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-changed-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG nova.compute.manager [req-9ab81a70-9965-41de-8927-c4126ef661ab req-28a19259-f44c-4f5b-b95e-049bd80834c5 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Refreshing instance network info cache due to event network-changed-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9ab81a70-9965-41de-8927-c4126ef661ab req-28a19259-f44c-4f5b-b95e-049bd80834c5 service nova] Acquiring lock "refresh_cache-06578dba-7003-4d6f-9500-086ba85ebee6" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9ab81a70-9965-41de-8927-c4126ef661ab req-28a19259-f44c-4f5b-b95e-049bd80834c5 service nova] Acquired lock "refresh_cache-06578dba-7003-4d6f-9500-086ba85ebee6" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:23:33 user nova-compute[74963]: DEBUG nova.network.neutron [req-9ab81a70-9965-41de-8927-c4126ef661ab req-28a19259-f44c-4f5b-b95e-049bd80834c5 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Refreshing network info cache for port 355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:23:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:34 user nova-compute[74963]: INFO nova.compute.manager [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Rebuilding instance
Nov 30 08:23:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.network.neutron [req-9ab81a70-9965-41de-8927-c4126ef661ab req-28a19259-f44c-4f5b-b95e-049bd80834c5 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Updated VIF entry in instance network info cache for port 355e7ed6-0e7a-430c-8d27-78f8c9bffbfd. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.network.neutron [req-9ab81a70-9965-41de-8927-c4126ef661ab req-28a19259-f44c-4f5b-b95e-049bd80834c5 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Updating instance_info_cache with network_info: [{"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9ab81a70-9965-41de-8927-c4126ef661ab req-28a19259-f44c-4f5b-b95e-049bd80834c5 service nova] Releasing lock "refresh_cache-06578dba-7003-4d6f-9500-086ba85ebee6" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.compute.manager [None req-058cb179-4a9a-4c9c-9370-14ff3230ad72 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-439ba36a-7432-4719-9527-fdd1e33539e2 req-751f73ba-ba5d-4300-b3f3-c6d4770748b3 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-439ba36a-7432-4719-9527-fdd1e33539e2 req-751f73ba-ba5d-4300-b3f3-c6d4770748b3 service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-439ba36a-7432-4719-9527-fdd1e33539e2 req-751f73ba-ba5d-4300-b3f3-c6d4770748b3 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-439ba36a-7432-4719-9527-fdd1e33539e2 req-751f73ba-ba5d-4300-b3f3-c6d4770748b3 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-439ba36a-7432-4719-9527-fdd1e33539e2 req-751f73ba-ba5d-4300-b3f3-c6d4770748b3 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:35 user nova-compute[74963]: WARNING nova.compute.manager [req-439ba36a-7432-4719-9527-fdd1e33539e2 req-751f73ba-ba5d-4300-b3f3-c6d4770748b3 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state active and task_state None.
Nov 30 08:23:35 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance destroyed successfully.
Nov 30 08:23:35 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance destroyed successfully.
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-811037316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1978623399',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPo15KF1HXLEyPpa+4O3PhxaN/ETMyQMGcI46Pp8izb9WazA93d3bhxCfOy90R6rUR5VCwbkC4GFrn21BszijXxqyFgAYkvjek38GdhPOnd1W1Jq/0lAq/720Jrz55UsQ==',key_name='tempest-keypair-765355062',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:22:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c77b6f8fefeb4df5b8da6752ae8d0a90',ramdisk_id='',reservation_id='r-8gmjeasr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1218377200',owner_user_name='tempest-ServerActionsV293TestJSON-1218377200-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38459c26cb7c4d229c2d9bdbfed447cb',uuid=06578dba-7003-4d6f-9500-086ba85ebee6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converting VIF {"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_vif [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap355e7ed6-0e, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e5c8f28-a9b1-4be5-a2d0-c981477c2f46) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:35 user nova-compute[74963]: INFO os_vif [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e')
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REqzrnPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:23:35 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2d0cff-3f6c-4783-9a3b-0371a8de7470]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:23:35 user nova-compute[74963]: No targets found.
Nov 30 08:23:35 user nova-compute[74963]: iSNS:
Nov 30 08:23:35 user nova-compute[74963]: No targets found.
Nov 30 08:23:35 user nova-compute[74963]: STATIC:
Nov 30 08:23:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a
Nov 30 08:23:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7
Nov 30 08:23:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:23:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:23:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:35 user nova-compute[74963]: FIRMWARE:
Nov 30 08:23:35 user nova-compute[74963]: No targets found.
Nov 30 08:23:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:23:35 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:23:35 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[738410b0-e86e-4c60-8a19-e097058dec8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa71a06a-a0fc-4c8d-9af0-3fcceb16be17]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:35 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:35 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:23:35 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:23:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:35 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:35 user nova-compute[74963]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:23:35 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:23:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624423ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a'): ({'sdg'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Removing single pathed devices sdg {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eebbc52-d870-463b-b3c2-52501a7a586e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-unplugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] No waiting events found dispatching network-vif-unplugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:35 user nova-compute[74963]: WARNING nova.compute.manager [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received unexpected event network-vif-unplugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd for instance with vm_state active and task_state rebuilding.
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] No waiting events found dispatching network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:23:35 user nova-compute[74963]: WARNING nova.compute.manager [req-52a421fe-dd1a-435d-ba7a-239c14c34cee req-d76decf3-0428-4d99-b676-10b38c818d58 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received unexpected event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd for instance with vm_state active and task_state rebuilding.
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3741296f-bb20-470c-b5c9-12eae5c34e73]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Flushing IO for device /dev/sdg {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73f05af-c9e7-46a8-9137-654e0ee81ce5]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ffac2c-90fd-4c09-834c-ccddb8d431e7]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:23:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] SCSI volumes sdg have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8859b8f8-964f-4658-a0d6-892aaf8d3e9b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704d86c-bd49-4a5c-a882-6176f8bdc85b]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260]
Nov 30 08:23:36 user nova-compute[74963]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260] successful.
Nov 30 08:23:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2827e17-6d5b-4ff6-8c5c-baf2a6c040f6]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] <== disconnect_volume: return (361ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:23:36 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Deleting instance files /opt/stack/data/nova/instances/06578dba-7003-4d6f-9500-086ba85ebee6_del
Nov 30 08:23:36 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Deletion of /opt/stack/data/nova/instances/06578dba-7003-4d6f-9500-086ba85ebee6_del complete
Nov 30 08:23:36 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 06578dba-7003-4d6f-9500-086ba85ebee6 could not be found.
Nov 30 08:23:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REqzrnPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:23:36 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc33dab0-78aa-4184-bfc3-62eb69c49245]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:23:36 user nova-compute[74963]: No targets found.
Nov 30 08:23:36 user nova-compute[74963]: iSNS:
Nov 30 08:23:36 user nova-compute[74963]: No targets found.
Nov 30 08:23:36 user nova-compute[74963]: STATIC:
Nov 30 08:23:36 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7
Nov 30 08:23:36 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:36 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:36 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:23:36 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:36 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:36 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:23:36 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:23:36 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:23:36 user nova-compute[74963]: FIRMWARE:
Nov 30 08:23:36 user nova-compute[74963]: No targets found.
Nov 30 08:23:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:23:36 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:23:36 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb6fc76-5ddc-433e-b189-dbbdb6c4b440]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7d853-29e3-426d-bc38-5c1c751aa3a1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:36 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:36 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:23:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:23:36 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:23:36 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:23:36 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244239b40>, {}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Disconnecting from: [] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] <== disconnect_volume: return (72ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:23:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:23:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Preparing to wait for external event volume-reimaged-618fb746-5223-416c-90a6-2fe2225c714a {{(pid=74963) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 30 08:23:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-13726715-2e86-426f-a149-cad756a61c41 req-26b46a75-62ce-4b3f-9c01-98a57ed96f8d service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event volume-reimaged-618fb746-5223-416c-90a6-2fe2225c714a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13726715-2e86-426f-a149-cad756a61c41 req-26b46a75-62ce-4b3f-9c01-98a57ed96f8d service nova] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13726715-2e86-426f-a149-cad756a61c41 req-26b46a75-62ce-4b3f-9c01-98a57ed96f8d service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-13726715-2e86-426f-a149-cad756a61c41 req-26b46a75-62ce-4b3f-9c01-98a57ed96f8d service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-13726715-2e86-426f-a149-cad756a61c41 req-26b46a75-62ce-4b3f-9c01-98a57ed96f8d service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Processing event volume-reimaged-618fb746-5223-416c-90a6-2fe2225c714a {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG nova.compute.manager [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:23:55 user nova-compute[74963]: INFO nova.virt.block_device [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Booting with volume 618fb746-5223-416c-90a6-2fe2225c714a at /dev/vda
Nov 30 08:23:55 user nova-compute[74963]: DEBUG os_brick.utils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12b1327-8335-4d3b-8ec3-75c22004ef25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e924e2-8ed1-499d-91cf-c8a93effda27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5503e6-7dda-46ba-af7a-76c6b32d9464]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7704f45b-1bc2-4868-aff2-3291c06d0a83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:23:55 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:23:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[267d2f86-8fbc-4629-b7d4-8bf9a8a1a605]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG os_brick.utils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Updating existing volume attachment record: 342ec4f1-ef5e-4a00-88cc-0383d9f3930e {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:23:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:23:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:02 user nova-compute[74963]: INFO nova.compute.manager [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Terminating instance
Nov 30 08:24:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-e321a0a5-49ce-4c3a-af5e-5997270df058 req-46e24437-8323-41fa-b213-a7ba6c2c3b6a service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received event network-vif-unplugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e321a0a5-49ce-4c3a-af5e-5997270df058 req-46e24437-8323-41fa-b213-a7ba6c2c3b6a service nova] Acquiring lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e321a0a5-49ce-4c3a-af5e-5997270df058 req-46e24437-8323-41fa-b213-a7ba6c2c3b6a service nova] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e321a0a5-49ce-4c3a-af5e-5997270df058 req-46e24437-8323-41fa-b213-a7ba6c2c3b6a service nova] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-e321a0a5-49ce-4c3a-af5e-5997270df058 req-46e24437-8323-41fa-b213-a7ba6c2c3b6a service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] No waiting events found dispatching network-vif-unplugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-e321a0a5-49ce-4c3a-af5e-5997270df058 req-46e24437-8323-41fa-b213-a7ba6c2c3b6a service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received event network-vif-unplugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Instance destroyed successfully.
Nov 30 08:24:03 user nova-compute[74963]: DEBUG nova.objects.instance [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'resources' on Instance uuid dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-327193947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-327193947',id=20,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-fbx0cwa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:16:37Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "address": "fa:16:3e:2e:1a:ac", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f64dde7-74", "ovs_interfaceid": "8f64dde7-746d-46bb-b42b-df2cbaa14592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:ac,bridge_name='br-int',has_traffic_filtering=True,id=8f64dde7-746d-46bb-b42b-df2cbaa14592,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f64dde7-74') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG os_vif [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:ac,bridge_name='br-int',has_traffic_filtering=True,id=8f64dde7-746d-46bb-b42b-df2cbaa14592,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f64dde7-74') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f64dde7-74, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53be2a74-dc6f-421b-b322-7c99afad8a5f) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:03 user nova-compute[74963]: INFO os_vif [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:ac,bridge_name='br-int',has_traffic_filtering=True,id=8f64dde7-746d-46bb-b42b-df2cbaa14592,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f64dde7-74')
Nov 30 08:24:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Deleting instance files /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105_del
Nov 30 08:24:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Deletion of /opt/stack/data/nova/instances/dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105_del complete
Nov 30 08:24:03 user nova-compute[74963]: INFO nova.compute.manager [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 30 08:24:03 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:24:03 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:24:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Creating image(s)
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Ensure instance console log exists: /opt/stack/data/nova/instances/06578dba-7003-4d6f-9500-086ba85ebee6/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Start _get_guest_xml network_info=[{"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REqzrnPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06578dba-7003-4d6f-9500-086ba85ebee6', 'attached_at': '', 'detached_at': '', 'volume_id': '618fb746-5223-416c-90a6-2fe2225c714a', 'serial': '618fb746-5223-416c-90a6-2fe2225c714a'}, 'attachment_id': '342ec4f1-ef5e-4a00-88cc-0383d9f3930e', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:24:04 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 08:24:04 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.objects.instance [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lazy-loading 'vcpu_model' on Instance uuid 06578dba-7003-4d6f-9500-086ba85ebee6 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REqzrnPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:24:04 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:24:04 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:24:04 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2064c9c1-fc97-4cc1-80b8-e0b65ae1c069]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:24:04 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef159fa7-9256-4621-92ab-ac3b84ac2b2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a] added
Nov 30 08:24:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a91937-e56a-4b70-8463-ee16f3692d70]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f200a012-658a-43ee-a291-fd6ea0777b7a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REqzrnPG {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REqzrnPG" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4de3c26-f725-475c-a485-8ad02754280a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'REqzrnPG'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6073967-a12b-4b5a-b5ef-13c78b2c661f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3dd6a6-b7b6-4bd3-a768-29f10427dd18]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db5833-601b-47ed-9d75-6f1fea014979]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260]
Nov 30 08:24:04 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260] successful.
Nov 30 08:24:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8866b904-9d89-4997-8412-591008c272c1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d1a2d-424a-478a-b879-859e2a387a55]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:04 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d05e21c-c721-499f-91a5-5e5f11714a15]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REqzrnPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:24:04 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Took 0.54 seconds to deallocate network for instance.
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-0df60da2-7a43-4eb6-a1f6-41c5a599d148 req-1081f500-8d04-4977-be44-8e301a913e02 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received event network-vif-deleted-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:04 user nova-compute[74963]: INFO nova.compute.manager [req-0df60da2-7a43-4eb6-a1f6-41c5a599d148 req-1081f500-8d04-4977-be44-8e301a913e02 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Neutron deleted interface 8f64dde7-746d-46bb-b42b-df2cbaa14592; detaching it from the instance and deleting it from the info cache
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-0df60da2-7a43-4eb6-a1f6-41c5a599d148 req-1081f500-8d04-4977-be44-8e301a913e02 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-0df60da2-7a43-4eb6-a1f6-41c5a599d148 req-1081f500-8d04-4977-be44-8e301a913e02 service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Detach interface failed, port_id=8f64dde7-746d-46bb-b42b-df2cbaa14592, reason: Instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105 could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:24:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:04 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Deleted allocations for instance dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105
Nov 30 08:24:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-53b378b3-880c-4248-b92b-6971b8258b12 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-342f8416-03d9-441f-aa38-7b195a758896 req-75e4912a-8e38-4d3d-ac3a-9076157966be service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received event network-vif-plugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-342f8416-03d9-441f-aa38-7b195a758896 req-75e4912a-8e38-4d3d-ac3a-9076157966be service nova] Acquiring lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-342f8416-03d9-441f-aa38-7b195a758896 req-75e4912a-8e38-4d3d-ac3a-9076157966be service nova] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-342f8416-03d9-441f-aa38-7b195a758896 req-75e4912a-8e38-4d3d-ac3a-9076157966be service nova] Lock "dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-342f8416-03d9-441f-aa38-7b195a758896 req-75e4912a-8e38-4d3d-ac3a-9076157966be service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] No waiting events found dispatching network-vif-plugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:05 user nova-compute[74963]: WARNING nova.compute.manager [req-342f8416-03d9-441f-aa38-7b195a758896 req-75e4912a-8e38-4d3d-ac3a-9076157966be service nova] [instance: dbe2a55a-dfb9-4cb4-9256-afbc6f0e9105] Received unexpected event network-vif-plugged-8f64dde7-746d-46bb-b42b-df2cbaa14592 for instance with vm_state deleted and task_state None.
Nov 30 08:24:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquired lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'info_cache' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23564333766333661', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564333766333661', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.objects.base [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T08:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-811037316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1978623399',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPo15KF1HXLEyPpa+4O3PhxaN/ETMyQMGcI46Pp8izb9WazA93d3bhxCfOy90R6rUR5VCwbkC4GFrn21BszijXxqyFgAYkvjek38GdhPOnd1W1Jq/0lAq/720Jrz55UsQ==',key_name='tempest-keypair-765355062',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:22:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c77b6f8fefeb4df5b8da6752ae8d0a90',ramdisk_id='',reservation_id='r-8gmjeasr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1218377200',owner_user_name='tempest-ServerActionsV293TestJSON-1218377200-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38459c26cb7c4d229c2d9bdbfed447cb',uuid=06578dba-7003-4d6f-9500-086ba85ebee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converting VIF {"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:24:05 user nova-compute[74963]:   <uuid>06578dba-7003-4d6f-9500-086ba85ebee6</uuid>
Nov 30 08:24:05 user nova-compute[74963]:   <name>instance-0000001c</name>
Nov 30 08:24:05 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:24:05 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:24:05 user nova-compute[74963]:   <metadata>
Nov 30 08:24:05 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:24:05 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:24:05 user nova-compute[74963]:       <nova:name>tempest-ServerActionsV293TestJSON-server-811037316</nova:name>
Nov 30 08:24:05 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:24:04</nova:creationTime>
Nov 30 08:24:05 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:24:05 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:24:05 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:24:05 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:24:05 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:24:05 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:24:05 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:24:05 user nova-compute[74963]:       <nova:owner>
Nov 30 08:24:05 user nova-compute[74963]:         <nova:user uuid="38459c26cb7c4d229c2d9bdbfed447cb">tempest-ServerActionsV293TestJSON-1218377200-project-member</nova:user>
Nov 30 08:24:05 user nova-compute[74963]:         <nova:project uuid="c77b6f8fefeb4df5b8da6752ae8d0a90">tempest-ServerActionsV293TestJSON-1218377200</nova:project>
Nov 30 08:24:05 user nova-compute[74963]:       </nova:owner>
Nov 30 08:24:05 user nova-compute[74963]:       <nova:ports>
Nov 30 08:24:05 user nova-compute[74963]:         <nova:port uuid="355e7ed6-0e7a-430c-8d27-78f8c9bffbfd">
Nov 30 08:24:05 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 08:24:05 user nova-compute[74963]:         </nova:port>
Nov 30 08:24:05 user nova-compute[74963]:       </nova:ports>
Nov 30 08:24:05 user nova-compute[74963]:     </nova:instance>
Nov 30 08:24:05 user nova-compute[74963]:   </metadata>
Nov 30 08:24:05 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:24:05 user nova-compute[74963]:     <system>
Nov 30 08:24:05 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:24:05 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:24:05 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:24:05 user nova-compute[74963]:       <entry name="serial">06578dba-7003-4d6f-9500-086ba85ebee6</entry>
Nov 30 08:24:05 user nova-compute[74963]:       <entry name="uuid">06578dba-7003-4d6f-9500-086ba85ebee6</entry>
Nov 30 08:24:05 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:24:05 user nova-compute[74963]:     </system>
Nov 30 08:24:05 user nova-compute[74963]:   </sysinfo>
Nov 30 08:24:05 user nova-compute[74963]:   <os>
Nov 30 08:24:05 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:24:05 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:24:05 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:24:05 user nova-compute[74963]:   </os>
Nov 30 08:24:05 user nova-compute[74963]:   <features>
Nov 30 08:24:05 user nova-compute[74963]:     <acpi/>
Nov 30 08:24:05 user nova-compute[74963]:     <apic/>
Nov 30 08:24:05 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:24:05 user nova-compute[74963]:   </features>
Nov 30 08:24:05 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:24:05 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:24:05 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:24:05 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:24:05 user nova-compute[74963]:   </clock>
Nov 30 08:24:05 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:24:05 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:24:05 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:24:05 user nova-compute[74963]:   </cpu>
Nov 30 08:24:05 user nova-compute[74963]:   <devices>
Nov 30 08:24:05 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:24:05 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:24:05 user nova-compute[74963]:       <source dev="/dev/sdc"/>
Nov 30 08:24:05 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:24:05 user nova-compute[74963]:       <serial>618fb746-5223-416c-90a6-2fe2225c714a</serial>
Nov 30 08:24:05 user nova-compute[74963]:     </disk>
Nov 30 08:24:05 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:24:05 user nova-compute[74963]:       <mac address="fa:16:3e:fd:07:35"/>
Nov 30 08:24:05 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:24:05 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:24:05 user nova-compute[74963]:       <target dev="tap355e7ed6-0e"/>
Nov 30 08:24:05 user nova-compute[74963]:     </interface>
Nov 30 08:24:05 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:24:05 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/06578dba-7003-4d6f-9500-086ba85ebee6/console.log" append="off"/>
Nov 30 08:24:05 user nova-compute[74963]:     </serial>
Nov 30 08:24:05 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:24:05 user nova-compute[74963]:     <video>
Nov 30 08:24:05 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:24:05 user nova-compute[74963]:     </video>
Nov 30 08:24:05 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:24:05 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:24:05 user nova-compute[74963]:     </rng>
Nov 30 08:24:05 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:24:05 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:24:05 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:24:05 user nova-compute[74963]:     </memballoon>
Nov 30 08:24:05 user nova-compute[74963]:   </devices>
Nov 30 08:24:05 user nova-compute[74963]: </domain>
Nov 30 08:24:05 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T08:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-811037316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1978623399',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPo15KF1HXLEyPpa+4O3PhxaN/ETMyQMGcI46Pp8izb9WazA93d3bhxCfOy90R6rUR5VCwbkC4GFrn21BszijXxqyFgAYkvjek38GdhPOnd1W1Jq/0lAq/720Jrz55UsQ==',key_name='tempest-keypair-765355062',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:22:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c77b6f8fefeb4df5b8da6752ae8d0a90',ramdisk_id='',reservation_id='r-8gmjeasr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1218377200',owner_user_name='tempest-ServerActionsV293TestJSON-1218377200-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38459c26cb7c4d229c2d9bdbfed447cb',uuid=06578dba-7003-4d6f-9500-086ba85ebee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converting VIF {"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG os_vif [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee087109-2a79-510a-ba5a-3e57fa7e5a83', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap355e7ed6-0e, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap355e7ed6-0e, col_values=(('qos', UUID('2987c454-5e64-4050-9b2b-f1a3678371c1')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap355e7ed6-0e, col_values=(('external_ids', {'iface-id': '355e7ed6-0e7a-430c-8d27-78f8c9bffbfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:07:35', 'vm-uuid': '06578dba-7003-4d6f-9500-086ba85ebee6'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: INFO os_vif [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e')
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] No VIF found with MAC fa:16:3e:fd:07:35, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updating instance_info_cache with network_info: [{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Releasing lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:24:05 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance destroyed successfully.
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'resources' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.objects.base [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-947669859',display_name='tempest-AttachVolumeTestJSON-server-947669859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-947669859',id=22,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB89fVSzhtfwm1Lv4FTMQ2ggrdWdEmZEvTquBWG5boPgjeuHpCpNY7WcHKpOKqoOmBzQZB62F68xan1ZQtOg94hSbmIl0OyitqdcaGNNsJ2QLVnxkTze3FfA/yhI2bNjhg==',key_name='tempest-keypair-1328476592',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-ls2r7c4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=ddde2d1c-aa4e-4415-ab80-6c5e217aae37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG os_vif [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf90eb0e-d1, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87aeb9a9-715d-42d3-8eb3-86cec16f3bdb) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:05 user nova-compute[74963]: INFO os_vif [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1')
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Start _get_guest_xml network_info=[{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'numa_topology' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:05 user nova-compute[74963]: DEBUG nova.objects.base [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:24:05 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:24:05 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'vcpu_model' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.objects.base [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-947669859',display_name='tempest-AttachVolumeTestJSON-server-947669859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-947669859',id=22,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB89fVSzhtfwm1Lv4FTMQ2ggrdWdEmZEvTquBWG5boPgjeuHpCpNY7WcHKpOKqoOmBzQZB62F68xan1ZQtOg94hSbmIl0OyitqdcaGNNsJ2QLVnxkTze3FfA/yhI2bNjhg==',key_name='tempest-keypair-1328476592',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-ls2r7c4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=ddde2d1c-aa4e-4415-ab80-6c5e217aae37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'pci_devices' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.objects.base [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:24:06 user nova-compute[74963]:   <uuid>ddde2d1c-aa4e-4415-ab80-6c5e217aae37</uuid>
Nov 30 08:24:06 user nova-compute[74963]:   <name>instance-00000016</name>
Nov 30 08:24:06 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:24:06 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:24:06 user nova-compute[74963]:   <metadata>
Nov 30 08:24:06 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:24:06 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:24:06 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeTestJSON-server-947669859</nova:name>
Nov 30 08:24:06 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:24:05</nova:creationTime>
Nov 30 08:24:06 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:24:06 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:24:06 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:24:06 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:24:06 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:24:06 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:24:06 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:24:06 user nova-compute[74963]:       <nova:owner>
Nov 30 08:24:06 user nova-compute[74963]:         <nova:user uuid="5faaefd1e3d946eba7123229378d79fe">tempest-AttachVolumeTestJSON-1519701713-project-member</nova:user>
Nov 30 08:24:06 user nova-compute[74963]:         <nova:project uuid="df8be2ffbe2e411590d35d9c12196ba8">tempest-AttachVolumeTestJSON-1519701713</nova:project>
Nov 30 08:24:06 user nova-compute[74963]:       </nova:owner>
Nov 30 08:24:06 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:24:06 user nova-compute[74963]:       <nova:ports>
Nov 30 08:24:06 user nova-compute[74963]:         <nova:port uuid="af90eb0e-d1c3-4629-9d1a-1c224e637b11">
Nov 30 08:24:06 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 08:24:06 user nova-compute[74963]:         </nova:port>
Nov 30 08:24:06 user nova-compute[74963]:       </nova:ports>
Nov 30 08:24:06 user nova-compute[74963]:     </nova:instance>
Nov 30 08:24:06 user nova-compute[74963]:   </metadata>
Nov 30 08:24:06 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:24:06 user nova-compute[74963]:     <system>
Nov 30 08:24:06 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:24:06 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:24:06 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:24:06 user nova-compute[74963]:       <entry name="serial">ddde2d1c-aa4e-4415-ab80-6c5e217aae37</entry>
Nov 30 08:24:06 user nova-compute[74963]:       <entry name="uuid">ddde2d1c-aa4e-4415-ab80-6c5e217aae37</entry>
Nov 30 08:24:06 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:24:06 user nova-compute[74963]:     </system>
Nov 30 08:24:06 user nova-compute[74963]:   </sysinfo>
Nov 30 08:24:06 user nova-compute[74963]:   <os>
Nov 30 08:24:06 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:24:06 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:24:06 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:24:06 user nova-compute[74963]:   </os>
Nov 30 08:24:06 user nova-compute[74963]:   <features>
Nov 30 08:24:06 user nova-compute[74963]:     <acpi/>
Nov 30 08:24:06 user nova-compute[74963]:     <apic/>
Nov 30 08:24:06 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:24:06 user nova-compute[74963]:   </features>
Nov 30 08:24:06 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:24:06 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:24:06 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:24:06 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:24:06 user nova-compute[74963]:   </clock>
Nov 30 08:24:06 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:24:06 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:24:06 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:24:06 user nova-compute[74963]:   </cpu>
Nov 30 08:24:06 user nova-compute[74963]:   <devices>
Nov 30 08:24:06 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:24:06 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:24:06 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk"/>
Nov 30 08:24:06 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:24:06 user nova-compute[74963]:     </disk>
Nov 30 08:24:06 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:24:06 user nova-compute[74963]:       <mac address="fa:16:3e:c2:ee:25"/>
Nov 30 08:24:06 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:24:06 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:24:06 user nova-compute[74963]:       <target dev="tapaf90eb0e-d1"/>
Nov 30 08:24:06 user nova-compute[74963]:     </interface>
Nov 30 08:24:06 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:24:06 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/console.log" append="off"/>
Nov 30 08:24:06 user nova-compute[74963]:     </serial>
Nov 30 08:24:06 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:24:06 user nova-compute[74963]:     <video>
Nov 30 08:24:06 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:24:06 user nova-compute[74963]:     </video>
Nov 30 08:24:06 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:24:06 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:24:06 user nova-compute[74963]:     </rng>
Nov 30 08:24:06 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:24:06 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:24:06 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:24:06 user nova-compute[74963]:     </memballoon>
Nov 30 08:24:06 user nova-compute[74963]:   </devices>
Nov 30 08:24:06 user nova-compute[74963]: </domain>
Nov 30 08:24:06 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'trusted_certs' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.objects.base [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Cannot resize image /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'migration_context' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.objects.base [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Object Instance<ddde2d1c-aa4e-4415-ab80-6c5e217aae37> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-947669859',display_name='tempest-AttachVolumeTestJSON-server-947669859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-947669859',id=22,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB89fVSzhtfwm1Lv4FTMQ2ggrdWdEmZEvTquBWG5boPgjeuHpCpNY7WcHKpOKqoOmBzQZB62F68xan1ZQtOg94hSbmIl0OyitqdcaGNNsJ2QLVnxkTze3FfA/yhI2bNjhg==',key_name='tempest-keypair-1328476592',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-ls2r7c4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=ddde2d1c-aa4e-4415-ab80-6c5e217aae37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG os_vif [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '953b5a5c-8a12-557b-b081-a3cce09a10e5', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf90eb0e-d1, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf90eb0e-d1, col_values=(('qos', UUID('6bdfbedf-7955-4a4a-9d3f-e3fcc0b7f560')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf90eb0e-d1, col_values=(('external_ids', {'iface-id': 'af90eb0e-d1c3-4629-9d1a-1c224e637b11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:ee:25', 'vm-uuid': 'ddde2d1c-aa4e-4415-ab80-6c5e217aae37'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:06 user nova-compute[74963]: INFO os_vif [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1')
Nov 30 08:24:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] No waiting events found dispatching network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:07 user nova-compute[74963]: WARNING nova.compute.manager [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received unexpected event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd for instance with vm_state active and task_state rebuild_spawning.
Nov 30 08:24:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] No waiting events found dispatching network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:07 user nova-compute[74963]: WARNING nova.compute.manager [req-4ebce189-8f7d-4ec9-90aa-6c32daeb3235 req-c59ee349-0dbd-482e-85a6-a85f4c97643c service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received unexpected event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd for instance with vm_state active and task_state rebuild_spawning.
Nov 30 08:24:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-0ea9945f-d3f2-475c-af34-adc3f252cb97 req-6d9e00d5-98d4-4f80-b476-588c6bceeb21 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0ea9945f-d3f2-475c-af34-adc3f252cb97 req-6d9e00d5-98d4-4f80-b476-588c6bceeb21 service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0ea9945f-d3f2-475c-af34-adc3f252cb97 req-6d9e00d5-98d4-4f80-b476-588c6bceeb21 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0ea9945f-d3f2-475c-af34-adc3f252cb97 req-6d9e00d5-98d4-4f80-b476-588c6bceeb21 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-0ea9945f-d3f2-475c-af34-adc3f252cb97 req-6d9e00d5-98d4-4f80-b476-588c6bceeb21 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:08 user nova-compute[74963]: WARNING nova.compute.manager [req-0ea9945f-d3f2-475c-af34-adc3f252cb97 req-6d9e00d5-98d4-4f80-b476-588c6bceeb21 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state stopped and task_state powering-on.
Nov 30 08:24:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:10 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance spawned successfully.
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.objects.instance [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74963) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-13726715-2e86-426f-a149-cad756a61c41 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.106s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:24:10 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance rebooted successfully.
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ae4cdb8-ddc9-45b9-b469-9f01030262e5 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-c92608fd-7092-4b8b-b687-db2e6f499d0f req-a9df5011-9c20-4197-bd40-b5ce410f08db service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c92608fd-7092-4b8b-b687-db2e6f499d0f req-a9df5011-9c20-4197-bd40-b5ce410f08db service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c92608fd-7092-4b8b-b687-db2e6f499d0f req-a9df5011-9c20-4197-bd40-b5ce410f08db service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c92608fd-7092-4b8b-b687-db2e6f499d0f req-a9df5011-9c20-4197-bd40-b5ce410f08db service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-c92608fd-7092-4b8b-b687-db2e6f499d0f req-a9df5011-9c20-4197-bd40-b5ce410f08db service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:10 user nova-compute[74963]: WARNING nova.compute.manager [req-c92608fd-7092-4b8b-b687-db2e6f499d0f req-a9df5011-9c20-4197-bd40-b5ce410f08db service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state stopped and task_state powering-on.
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:24:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:14 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:24:14 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8031MB free_disk=25.184783935546875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 06578dba-7003-4d6f-9500-086ba85ebee6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:24:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:24:15 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:24:15 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:24:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:24:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:24:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:24:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:24:16 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:24:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updating instance_info_cache with network_info: [{"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:24:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:24:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:24:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:24:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:24:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:36 user nova-compute[74963]: DEBUG nova.compute.manager [req-b47547f3-b114-4800-8038-7b13a1debabc req-db3aed9a-6e73-44c4-9c40-245d9264a3b3 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received event network-changed-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:36 user nova-compute[74963]: DEBUG nova.compute.manager [req-b47547f3-b114-4800-8038-7b13a1debabc req-db3aed9a-6e73-44c4-9c40-245d9264a3b3 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Refreshing instance network info cache due to event network-changed-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:24:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b47547f3-b114-4800-8038-7b13a1debabc req-db3aed9a-6e73-44c4-9c40-245d9264a3b3 service nova] Acquiring lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:24:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b47547f3-b114-4800-8038-7b13a1debabc req-db3aed9a-6e73-44c4-9c40-245d9264a3b3 service nova] Acquired lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:24:36 user nova-compute[74963]: DEBUG nova.network.neutron [req-b47547f3-b114-4800-8038-7b13a1debabc req-db3aed9a-6e73-44c4-9c40-245d9264a3b3 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Refreshing network info cache for port bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:24:36 user nova-compute[74963]: DEBUG nova.network.neutron [req-b47547f3-b114-4800-8038-7b13a1debabc req-db3aed9a-6e73-44c4-9c40-245d9264a3b3 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updated VIF entry in instance network info cache for port bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:24:36 user nova-compute[74963]: DEBUG nova.network.neutron [req-b47547f3-b114-4800-8038-7b13a1debabc req-db3aed9a-6e73-44c4-9c40-245d9264a3b3 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updating instance_info_cache with network_info: [{"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:24:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b47547f3-b114-4800-8038-7b13a1debabc req-db3aed9a-6e73-44c4-9c40-245d9264a3b3 service nova] Releasing lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:24:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-039ac999-9a66-4485-b5c1-0e8837ab6802 req-806104a7-392e-48d0-beab-e9facc79abf6 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-changed-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-039ac999-9a66-4485-b5c1-0e8837ab6802 req-806104a7-392e-48d0-beab-e9facc79abf6 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Refreshing instance network info cache due to event network-changed-235245f2-5cdc-4b02-8941-beafefbcd5e2. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-039ac999-9a66-4485-b5c1-0e8837ab6802 req-806104a7-392e-48d0-beab-e9facc79abf6 service nova] Acquiring lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-039ac999-9a66-4485-b5c1-0e8837ab6802 req-806104a7-392e-48d0-beab-e9facc79abf6 service nova] Acquired lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG nova.network.neutron [req-039ac999-9a66-4485-b5c1-0e8837ab6802 req-806104a7-392e-48d0-beab-e9facc79abf6 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Refreshing network info cache for port 235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Stashing vm_state: active {{(pid=74963) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:24:38 user nova-compute[74963]: INFO nova.compute.claims [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Claim successful on node user
Nov 30 08:24:38 user nova-compute[74963]: INFO nova.compute.resource_tracker [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating resource usage from migration 1c353468-c767-492a-b7bd-065fdccd9d6a
Nov 30 08:24:38 user nova-compute[74963]: DEBUG nova.network.neutron [req-039ac999-9a66-4485-b5c1-0e8837ab6802 req-806104a7-392e-48d0-beab-e9facc79abf6 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updated VIF entry in instance network info cache for port 235245f2-5cdc-4b02-8941-beafefbcd5e2. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG nova.network.neutron [req-039ac999-9a66-4485-b5c1-0e8837ab6802 req-806104a7-392e-48d0-beab-e9facc79abf6 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating instance_info_cache with network_info: [{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-039ac999-9a66-4485-b5c1-0e8837ab6802 req-806104a7-392e-48d0-beab-e9facc79abf6 service nova] Releasing lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:24:38 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.575s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:39 user nova-compute[74963]: INFO nova.compute.manager [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Migrating
Nov 30 08:24:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquired lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating instance_info_cache with network_info: [{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Releasing lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Starting migrate_disk_and_power_off {{(pid=74963) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-f7f1ce37-919e-4a08-8a5d-a5c69758d8ff req-8c9bccbe-227d-459f-8bbf-ce15732d3e71 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-unplugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f7f1ce37-919e-4a08-8a5d-a5c69758d8ff req-8c9bccbe-227d-459f-8bbf-ce15732d3e71 service nova] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f7f1ce37-919e-4a08-8a5d-a5c69758d8ff req-8c9bccbe-227d-459f-8bbf-ce15732d3e71 service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f7f1ce37-919e-4a08-8a5d-a5c69758d8ff req-8c9bccbe-227d-459f-8bbf-ce15732d3e71 service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-f7f1ce37-919e-4a08-8a5d-a5c69758d8ff req-8c9bccbe-227d-459f-8bbf-ce15732d3e71 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] No waiting events found dispatching network-vif-unplugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:40 user nova-compute[74963]: WARNING nova.compute.manager [req-f7f1ce37-919e-4a08-8a5d-a5c69758d8ff req-8c9bccbe-227d-459f-8bbf-ce15732d3e71 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received unexpected event network-vif-unplugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 for instance with vm_state active and task_state resize_migrating.
Nov 30 08:24:40 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Instance destroyed successfully.
Nov 30 08:24:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-458762508',display_name='tempest-ServerActionsTestOtherA-server-458762508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-458762508',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsWMnq1ufqR++qStn5b43QWm222qTuytohSz8l1/sudpdFVTZkwiTwMp7sHBCXTNfQV4IhtlWVxhMZmDIqgf0oPJwcUspQxqKKVyuXcOkB5qHVJX6ziQnRILaSQcb0Pg==',key_name='tempest-keypair-537501141',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:23:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-m1zjngta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=4b7e702a-7148-4e96-bf46-9fe600dc5dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1264134844-network", "vif_mac": "fa:16:3e:9b:11:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1264134844-network", "vif_mac": "fa:16:3e:9b:11:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_vif [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap235245f2-5c, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17f5a6d1-360f-4e7b-9ee8-3682484ad1ca) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:40 user nova-compute[74963]: INFO os_vif [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c')
Nov 30 08:24:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZniHaxqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:24:40 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04c954d-8529-46a4-b4b1-6945399ec5ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:24:40 user nova-compute[74963]: No targets found.
Nov 30 08:24:40 user nova-compute[74963]: iSNS:
Nov 30 08:24:40 user nova-compute[74963]: No targets found.
Nov 30 08:24:40 user nova-compute[74963]: STATIC:
Nov 30 08:24:40 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a
Nov 30 08:24:40 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:24:40 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:24:40 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7
Nov 30 08:24:40 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:24:40 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:24:40 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:24:40 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:24:40 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:24:40 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:24:40 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:24:40 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:24:40 user nova-compute[74963]: FIRMWARE:
Nov 30 08:24:40 user nova-compute[74963]: No targets found.
Nov 30 08:24:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:24:40 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:24:40 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d8037f-d59a-4ca7-9f13-8b92c725b2a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac59d3f1-2289-4506-a5fd-b633d35eccc2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:40 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:40 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:40 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:40 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:40 user nova-compute[74963]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:40 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62445e24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7'): ({'sde'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Removing single pathed devices sde {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7ad705-a535-4558-b0be-4b608e69d349]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4849ea-8a47-4194-ab2a-3ead2c38548d]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flushing IO for device /dev/sde {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecfeb84-e0e3-4871-a82d-3c33912dcde6]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbeb323-74f5-40ca-882e-2249d83a6fb2]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2a93dffc', '/dev/disk/by-id/scsi-1SCST_BIO2a93dffc-9830ca37e00dc933', '/dev/disk/by-id/scsi-23938333063613337') {{(pid=86506) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[99876c12-8b8d-4e02-8557-41c93d1fefdc]: (4, None) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9142ad7-9cd7-4651-b914-cc1c1e17367d]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed750ba-7ae3-4428-9c32-80a1395343fe]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260]
Nov 30 08:24:40 user nova-compute[74963]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260] successful.
Nov 30 08:24:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b733b9a7-75d3-4bed-bd3a-42a748a41502]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== disconnect_volume: return (344ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:24:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:24:41 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Port 235245f2-5cdc-4b02-8941-beafefbcd5e2 binding to destination host user is already ACTIVE {{(pid=74963) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquired lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-d1559a3f-6d47-493d-9134-483918f1ebe5 req-4e286234-a4b1-4352-aaac-048d7c4df8ef service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d1559a3f-6d47-493d-9134-483918f1ebe5 req-4e286234-a4b1-4352-aaac-048d7c4df8ef service nova] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d1559a3f-6d47-493d-9134-483918f1ebe5 req-4e286234-a4b1-4352-aaac-048d7c4df8ef service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d1559a3f-6d47-493d-9134-483918f1ebe5 req-4e286234-a4b1-4352-aaac-048d7c4df8ef service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-d1559a3f-6d47-493d-9134-483918f1ebe5 req-4e286234-a4b1-4352-aaac-048d7c4df8ef service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] No waiting events found dispatching network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:42 user nova-compute[74963]: WARNING nova.compute.manager [req-d1559a3f-6d47-493d-9134-483918f1ebe5 req-4e286234-a4b1-4352-aaac-048d7c4df8ef service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received unexpected event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 for instance with vm_state active and task_state resize_migrated.
Nov 30 08:24:42 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating instance_info_cache with network_info: [{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Releasing lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG os_brick.utils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[538877cd-51b7-4f0d-9ec6-c9f80ab96f9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d8f9be-9a12-40d2-81cc-b5847a229473]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7bd293-845a-40be-a1eb-b1075837bf14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04652c-a92c-4b58-b5cf-84fe3f06a020]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:24:42 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:24:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[664ed8d9-d1b0-4f44-b194-d2b03d631209]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:24:42 user nova-compute[74963]: DEBUG os_brick.utils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:24:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Starting finish_migration {{(pid=74963) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Instance directory exists: not creating {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 08:24:51 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Creating image(s)
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Ensure instance console log exists: /opt/stack/data/nova/instances/4b7e702a-7148-4e96-bf46-9fe600dc5dce/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Start _get_guest_xml network_info=[{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1264134844-network", "vif_mac": "fa:16:3e:9b:11:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZniHaxqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4b7e702a-7148-4e96-bf46-9fe600dc5dce', 'attached_at': '2023-11-30T08:24:51.000000', 'detached_at': '', 'volume_id': '1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'serial': '1ad36f73-d092-4acf-aac7-0969e77ebeb7'}, 'attachment_id': 'a6307aba-eb98-4b52-a8f7-757fabde1529', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:24:51 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:24:51 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZniHaxqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:24:51 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:24:51 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:24:51 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b52f166-2fd9-436c-923f-5e1fa8a44537]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:24:51 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b8ca3b-eaaa-4aa5-9abd-ed282473f604]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7] added
Nov 30 08:24:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[046e112d-cf9d-4982-91d8-ce7cabcc0877]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5f55e7-3e5e-49a5-835e-951e1ccfc6f7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZniHaxqo {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZniHaxqo" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7f7a7-66aa-43da-a2d1-658ce9b83047]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZniHaxqo'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd224c8-aad9-4347-a520-378e619558e0]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12215ca-3ebc-400b-b9e6-44af5bfe1766]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf308e8-3558-4f4f-b8ce-d6e2806b4bfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260]
Nov 30 08:24:51 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260] successful.
Nov 30 08:24:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e74fb6-a8bb-4f47-a2d8-8d87f0d72602]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21df56c-3c3c-4a7d-b9ad-28a237e7e113]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:51 user nova-compute[74963]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9074c41f-352a-44e2-bd18-424b97df22ce]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:24:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZniHaxqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23938333063613337', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938333063613337', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-458762508',display_name='tempest-ServerActionsTestOtherA-server-458762508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-458762508',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsWMnq1ufqR++qStn5b43QWm222qTuytohSz8l1/sudpdFVTZkwiTwMp7sHBCXTNfQV4IhtlWVxhMZmDIqgf0oPJwcUspQxqKKVyuXcOkB5qHVJX6ziQnRILaSQcb0Pg==',key_name='tempest-keypair-537501141',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:23:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-m1zjngta',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=4b7e702a-7148-4e96-bf46-9fe600dc5dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1264134844-network", "vif_mac": "fa:16:3e:9b:11:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1264134844-network", "vif_mac": "fa:16:3e:9b:11:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:24:52 user nova-compute[74963]:   <uuid>4b7e702a-7148-4e96-bf46-9fe600dc5dce</uuid>
Nov 30 08:24:52 user nova-compute[74963]:   <name>instance-0000001d</name>
Nov 30 08:24:52 user nova-compute[74963]:   <memory>2097152</memory>
Nov 30 08:24:52 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:24:52 user nova-compute[74963]:   <metadata>
Nov 30 08:24:52 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:24:52 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:24:52 user nova-compute[74963]:       <nova:name>tempest-ServerActionsTestOtherA-server-458762508</nova:name>
Nov 30 08:24:52 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:24:51</nova:creationTime>
Nov 30 08:24:52 user nova-compute[74963]:       <nova:flavor name="m1.small">
Nov 30 08:24:52 user nova-compute[74963]:         <nova:memory>2048</nova:memory>
Nov 30 08:24:52 user nova-compute[74963]:         <nova:disk>20</nova:disk>
Nov 30 08:24:52 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:24:52 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:24:52 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:24:52 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:24:52 user nova-compute[74963]:       <nova:owner>
Nov 30 08:24:52 user nova-compute[74963]:         <nova:user uuid="c803479aa87e4be79682975d47b7ccfd">tempest-ServerActionsTestOtherA-768867057-project-member</nova:user>
Nov 30 08:24:52 user nova-compute[74963]:         <nova:project uuid="e22db86fd7a54c5c9882623605de5608">tempest-ServerActionsTestOtherA-768867057</nova:project>
Nov 30 08:24:52 user nova-compute[74963]:       </nova:owner>
Nov 30 08:24:52 user nova-compute[74963]:       <nova:ports>
Nov 30 08:24:52 user nova-compute[74963]:         <nova:port uuid="235245f2-5cdc-4b02-8941-beafefbcd5e2">
Nov 30 08:24:52 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 08:24:52 user nova-compute[74963]:         </nova:port>
Nov 30 08:24:52 user nova-compute[74963]:       </nova:ports>
Nov 30 08:24:52 user nova-compute[74963]:     </nova:instance>
Nov 30 08:24:52 user nova-compute[74963]:   </metadata>
Nov 30 08:24:52 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:24:52 user nova-compute[74963]:     <system>
Nov 30 08:24:52 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:24:52 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:24:52 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:24:52 user nova-compute[74963]:       <entry name="serial">4b7e702a-7148-4e96-bf46-9fe600dc5dce</entry>
Nov 30 08:24:52 user nova-compute[74963]:       <entry name="uuid">4b7e702a-7148-4e96-bf46-9fe600dc5dce</entry>
Nov 30 08:24:52 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:24:52 user nova-compute[74963]:     </system>
Nov 30 08:24:52 user nova-compute[74963]:   </sysinfo>
Nov 30 08:24:52 user nova-compute[74963]:   <os>
Nov 30 08:24:52 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:24:52 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:24:52 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:24:52 user nova-compute[74963]:   </os>
Nov 30 08:24:52 user nova-compute[74963]:   <features>
Nov 30 08:24:52 user nova-compute[74963]:     <acpi/>
Nov 30 08:24:52 user nova-compute[74963]:     <apic/>
Nov 30 08:24:52 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:24:52 user nova-compute[74963]:   </features>
Nov 30 08:24:52 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:24:52 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:24:52 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:24:52 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:24:52 user nova-compute[74963]:   </clock>
Nov 30 08:24:52 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:24:52 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:24:52 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:24:52 user nova-compute[74963]:   </cpu>
Nov 30 08:24:52 user nova-compute[74963]:   <devices>
Nov 30 08:24:52 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:24:52 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:24:52 user nova-compute[74963]:       <source dev="/dev/sde"/>
Nov 30 08:24:52 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:24:52 user nova-compute[74963]:       <serial>1ad36f73-d092-4acf-aac7-0969e77ebeb7</serial>
Nov 30 08:24:52 user nova-compute[74963]:     </disk>
Nov 30 08:24:52 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:24:52 user nova-compute[74963]:       <mac address="fa:16:3e:9b:11:4a"/>
Nov 30 08:24:52 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:24:52 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:24:52 user nova-compute[74963]:       <target dev="tap235245f2-5c"/>
Nov 30 08:24:52 user nova-compute[74963]:     </interface>
Nov 30 08:24:52 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:24:52 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/4b7e702a-7148-4e96-bf46-9fe600dc5dce/console.log" append="off"/>
Nov 30 08:24:52 user nova-compute[74963]:     </serial>
Nov 30 08:24:52 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:24:52 user nova-compute[74963]:     <video>
Nov 30 08:24:52 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:24:52 user nova-compute[74963]:     </video>
Nov 30 08:24:52 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:24:52 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:24:52 user nova-compute[74963]:     </rng>
Nov 30 08:24:52 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:24:52 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:24:52 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:24:52 user nova-compute[74963]:     </memballoon>
Nov 30 08:24:52 user nova-compute[74963]:   </devices>
Nov 30 08:24:52 user nova-compute[74963]: </domain>
Nov 30 08:24:52 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-458762508',display_name='tempest-ServerActionsTestOtherA-server-458762508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-458762508',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsWMnq1ufqR++qStn5b43QWm222qTuytohSz8l1/sudpdFVTZkwiTwMp7sHBCXTNfQV4IhtlWVxhMZmDIqgf0oPJwcUspQxqKKVyuXcOkB5qHVJX6ziQnRILaSQcb0Pg==',key_name='tempest-keypair-537501141',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:23:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-m1zjngta',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=4b7e702a-7148-4e96-bf46-9fe600dc5dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1264134844-network", "vif_mac": "fa:16:3e:9b:11:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1264134844-network", "vif_mac": "fa:16:3e:9b:11:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG os_vif [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d8118d2-d8f1-5127-9ce0-73c5fdc4dc95', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap235245f2-5c, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap235245f2-5c, col_values=(('qos', UUID('2ea59d57-e940-4223-bfc6-78750844690a')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap235245f2-5c, col_values=(('external_ids', {'iface-id': '235245f2-5cdc-4b02-8941-beafefbcd5e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:11:4a', 'vm-uuid': '4b7e702a-7148-4e96-bf46-9fe600dc5dce'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:24:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:52 user nova-compute[74963]: INFO os_vif [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c')
Nov 30 08:24:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] No VIF found with MAC fa:16:3e:9b:11:4a, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:53 user nova-compute[74963]: INFO nova.compute.manager [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Terminating instance
Nov 30 08:24:53 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-4157114a-c214-4916-9331-4064a920cd6a req-9d9fc6ab-ad3b-48b8-a44a-1456629eecfe service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-unplugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4157114a-c214-4916-9331-4064a920cd6a req-9d9fc6ab-ad3b-48b8-a44a-1456629eecfe service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4157114a-c214-4916-9331-4064a920cd6a req-9d9fc6ab-ad3b-48b8-a44a-1456629eecfe service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4157114a-c214-4916-9331-4064a920cd6a req-9d9fc6ab-ad3b-48b8-a44a-1456629eecfe service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-4157114a-c214-4916-9331-4064a920cd6a req-9d9fc6ab-ad3b-48b8-a44a-1456629eecfe service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-unplugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-4157114a-c214-4916-9331-4064a920cd6a req-9d9fc6ab-ad3b-48b8-a44a-1456629eecfe service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-unplugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Instance destroyed successfully.
Nov 30 08:24:54 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'resources' on Instance uuid 70392773-3fa7-4fb1-8513-9f0391f9e0e0 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074003933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074003933',id=12,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-vnr2mkxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:12:51Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=70392773-3fa7-4fb1-8513-9f0391f9e0e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "address": "fa:16:3e:68:eb:73", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203987cf-1c", "ovs_interfaceid": "203987cf-1c90-44b7-9ca1-1eed9597d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=203987cf-1c90-44b7-9ca1-1eed9597d71a,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203987cf-1c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_vif [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=203987cf-1c90-44b7-9ca1-1eed9597d71a,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203987cf-1c') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap203987cf-1c, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=867cd203-890e-4b53-beac-e82e68c42b33) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: INFO os_vif [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=203987cf-1c90-44b7-9ca1-1eed9597d71a,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203987cf-1c')
Nov 30 08:24:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzJfqBWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:24:54 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac73bd-55c2-4906-aa92-d3b23020cecb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:24:54 user nova-compute[74963]: No targets found.
Nov 30 08:24:54 user nova-compute[74963]: iSNS:
Nov 30 08:24:54 user nova-compute[74963]: No targets found.
Nov 30 08:24:54 user nova-compute[74963]: STATIC:
Nov 30 08:24:54 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a
Nov 30 08:24:54 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:24:54 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:24:54 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7
Nov 30 08:24:54 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:24:54 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:24:54 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:24:54 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:24:54 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:24:54 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f
Nov 30 08:24:54 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:24:54 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:24:54 user nova-compute[74963]: FIRMWARE:
Nov 30 08:24:54 user nova-compute[74963]: No targets found.
Nov 30 08:24:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:24:54 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:24:54 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dae8a24-129c-4784-a2c4-d765f1ae9cad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80781a-ccde-4580-876e-03ef9e0a85b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:54 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:54 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:54 user nova-compute[74963]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f (non-flash)
Nov 30 08:24:54 user nova-compute[74963]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:24:54 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:24:54 user nova-compute[74963]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:24:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62444c5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f'): ({'sdd'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Removing single pathed devices sdd {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa434e1-22e0-4b7a-b2c5-1f08d08cd5dc]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[22baa83a-e7d3-4a59-8ce6-542f9e402af4]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Flushing IO for device /dev/sdd {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-c8fbce34-f947-4788-b8c4-ed0e7d6871d4 req-1d281dc4-9d1d-4ad5-a11b-71fc9c1f79ec service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c8fbce34-f947-4788-b8c4-ed0e7d6871d4 req-1d281dc4-9d1d-4ad5-a11b-71fc9c1f79ec service nova] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c8fbce34-f947-4788-b8c4-ed0e7d6871d4 req-1d281dc4-9d1d-4ad5-a11b-71fc9c1f79ec service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c8fbce34-f947-4788-b8c4-ed0e7d6871d4 req-1d281dc4-9d1d-4ad5-a11b-71fc9c1f79ec service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-c8fbce34-f947-4788-b8c4-ed0e7d6871d4 req-1d281dc4-9d1d-4ad5-a11b-71fc9c1f79ec service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] No waiting events found dispatching network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:54 user nova-compute[74963]: WARNING nova.compute.manager [req-c8fbce34-f947-4788-b8c4-ed0e7d6871d4 req-1d281dc4-9d1d-4ad5-a11b-71fc9c1f79ec service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received unexpected event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 for instance with vm_state active and task_state resize_finish.
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ec909e-bf80-4804-b831-903bc3a1b94c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16b7fef-764a-45c1-8f82-49c6eff95044]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[84505807-60d4-4dcc-b220-1723a72bcb83]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82e27ab-fbeb-40a8-9c36-c849034cee5e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f, portal: 172.16.0.220,3260]
Nov 30 08:24:54 user nova-compute[74963]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f, portal: 172.16.0.220,3260] successful.
Nov 30 08:24:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:959c79f1-2657-4e31-9f80-c2c7f120d46f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf858bad-8252-48ab-a0f4-c50bda260529]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] <== disconnect_volume: return (343ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:24:55 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Deleting instance files /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0_del
Nov 30 08:24:55 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Deletion of /opt/stack/data/nova/instances/70392773-3fa7-4fb1-8513-9f0391f9e0e0_del complete
Nov 30 08:24:55 user nova-compute[74963]: INFO nova.compute.manager [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Took 1.60 seconds to destroy the instance on the hypervisor.
Nov 30 08:24:55 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:24:55 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Took 0.44 seconds to deallocate network for instance.
Nov 30 08:24:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-cf100d00-da56-4c43-a955-e59752633753 req-67dcd019-06cf-4b99-bf38-a1a948b5b2a2 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cf100d00-da56-4c43-a955-e59752633753 req-67dcd019-06cf-4b99-bf38-a1a948b5b2a2 service nova] Acquiring lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cf100d00-da56-4c43-a955-e59752633753 req-67dcd019-06cf-4b99-bf38-a1a948b5b2a2 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cf100d00-da56-4c43-a955-e59752633753 req-67dcd019-06cf-4b99-bf38-a1a948b5b2a2 service nova] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-cf100d00-da56-4c43-a955-e59752633753 req-67dcd019-06cf-4b99-bf38-a1a948b5b2a2 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] No waiting events found dispatching network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:55 user nova-compute[74963]: WARNING nova.compute.manager [req-cf100d00-da56-4c43-a955-e59752633753 req-67dcd019-06cf-4b99-bf38-a1a948b5b2a2 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received unexpected event network-vif-plugged-203987cf-1c90-44b7-9ca1-1eed9597d71a for instance with vm_state active and task_state deleting.
Nov 30 08:24:55 user nova-compute[74963]: DEBUG nova.compute.manager [req-cf100d00-da56-4c43-a955-e59752633753 req-67dcd019-06cf-4b99-bf38-a1a948b5b2a2 service nova] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Received event network-vif-deleted-203987cf-1c90-44b7-9ca1-1eed9597d71a {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:56 user nova-compute[74963]: INFO nova.compute.manager [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 70392773-3fa7-4fb1-8513-9f0391f9e0e0] Took 0.79 seconds to detach 1 volumes for instance.
Nov 30 08:24:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:56 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Deleted allocations for instance 70392773-3fa7-4fb1-8513-9f0391f9e0e0
Nov 30 08:24:56 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:24:56 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Instance running successfully.
Nov 30 08:24:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Failed to set time: agent not configured {{(pid=74963) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9ceb417-838a-41c5-b7e8-55df1aa6ae6f tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] finish_migration finished successfully. {{(pid=74963) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e2dafaf0-8659-4c7c-9bc5-715dd7887417 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "70392773-3fa7-4fb1-8513-9f0391f9e0e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.386s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-293b52d0-862f-4f9d-964c-cc3f868e5cd1 req-00a75832-2f33-450f-b3b4-c22401cc337e service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-293b52d0-862f-4f9d-964c-cc3f868e5cd1 req-00a75832-2f33-450f-b3b4-c22401cc337e service nova] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-293b52d0-862f-4f9d-964c-cc3f868e5cd1 req-00a75832-2f33-450f-b3b4-c22401cc337e service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-293b52d0-862f-4f9d-964c-cc3f868e5cd1 req-00a75832-2f33-450f-b3b4-c22401cc337e service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:24:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-293b52d0-862f-4f9d-964c-cc3f868e5cd1 req-00a75832-2f33-450f-b3b4-c22401cc337e service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] No waiting events found dispatching network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:24:56 user nova-compute[74963]: WARNING nova.compute.manager [req-293b52d0-862f-4f9d-964c-cc3f868e5cd1 req-00a75832-2f33-450f-b3b4-c22401cc337e service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received unexpected event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 for instance with vm_state active and task_state resize_finish.
Nov 30 08:24:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:24:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:25:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:10 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:25:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:14 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:25:14 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=7813MB free_disk=25.181167602539062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Applying migration context for instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce as it has an incoming, in-progress migration 1c353468-c767-492a-b7bd-065fdccd9d6a. Migration status is finished {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 08:25:14 user nova-compute[74963]: INFO nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating resource usage from migration 1c353468-c767-492a-b7bd-065fdccd9d6a
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 68bcb314-8197-4fe6-b986-b2554c822545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 06578dba-7003-4d6f-9500-086ba85ebee6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Migration 1c353468-c767-492a-b7bd-065fdccd9d6a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:25:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:25:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:25:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:25:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:25:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:25:16 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:25:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updating instance_info_cache with network_info: [{"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:25:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-ddde2d1c-aa4e-4415-ab80-6c5e217aae37" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:25:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:25:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:25:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:25:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:25:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:25:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:25:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-b6579f74-5fd7-433e-b418-c5f05a8d520e req-3d6fc3e9-126f-4ba3-97b7-d8a5b0e5edc7 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-changed-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-b6579f74-5fd7-433e-b418-c5f05a8d520e req-3d6fc3e9-126f-4ba3-97b7-d8a5b0e5edc7 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Refreshing instance network info cache due to event network-changed-954e13fe-66db-4b7f-9ff1-ad70f956e95f. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b6579f74-5fd7-433e-b418-c5f05a8d520e req-3d6fc3e9-126f-4ba3-97b7-d8a5b0e5edc7 service nova] Acquiring lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b6579f74-5fd7-433e-b418-c5f05a8d520e req-3d6fc3e9-126f-4ba3-97b7-d8a5b0e5edc7 service nova] Acquired lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-b6579f74-5fd7-433e-b418-c5f05a8d520e req-3d6fc3e9-126f-4ba3-97b7-d8a5b0e5edc7 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Refreshing network info cache for port 954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:22 user nova-compute[74963]: INFO nova.compute.manager [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Detaching volume 3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:25:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-b6579f74-5fd7-433e-b418-c5f05a8d520e req-3d6fc3e9-126f-4ba3-97b7-d8a5b0e5edc7 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updated VIF entry in instance network info cache for port 954e13fe-66db-4b7f-9ff1-ad70f956e95f. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-b6579f74-5fd7-433e-b418-c5f05a8d520e req-3d6fc3e9-126f-4ba3-97b7-d8a5b0e5edc7 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updating instance_info_cache with network_info: [{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b6579f74-5fd7-433e-b418-c5f05a8d520e req-3d6fc3e9-126f-4ba3-97b7-d8a5b0e5edc7 service nova] Releasing lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:25:22 user nova-compute[74963]: INFO nova.virt.block_device [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Attempting to driver detach volume 3d599c96-806d-4363-95be-3d98b1f92811 from mountpoint /dev/vdb
Nov 30 08:25:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Attempting to detach device vdb from instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:25:22 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:25:22 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:25:22 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:25:22 user nova-compute[74963]:   <serial>3d599c96-806d-4363-95be-3d98b1f92811</serial>
Nov 30 08:25:22 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:25:22 user nova-compute[74963]: </disk>
Nov 30 08:25:22 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:25:22 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Successfully detached device vdb from instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca from the persistent domain config.
Nov 30 08:25:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:25:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:25:22 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:25:22 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:25:22 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:25:22 user nova-compute[74963]:   <serial>3d599c96-806d-4363-95be-3d98b1f92811</serial>
Nov 30 08:25:22 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:25:22 user nova-compute[74963]: </disk>
Nov 30 08:25:22 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:25:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-78d70912-0367-420a-8744-e43068e30f96 req-09c6b8e2-ceb4-4483-85a5-bfcf09fee8f0 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-changed-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG nova.compute.manager [req-78d70912-0367-420a-8744-e43068e30f96 req-09c6b8e2-ceb4-4483-85a5-bfcf09fee8f0 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Refreshing instance network info cache due to event network-changed-954e13fe-66db-4b7f-9ff1-ad70f956e95f. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-78d70912-0367-420a-8744-e43068e30f96 req-09c6b8e2-ceb4-4483-85a5-bfcf09fee8f0 service nova] Acquiring lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-78d70912-0367-420a-8744-e43068e30f96 req-09c6b8e2-ceb4-4483-85a5-bfcf09fee8f0 service nova] Acquired lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-78d70912-0367-420a-8744-e43068e30f96 req-09c6b8e2-ceb4-4483-85a5-bfcf09fee8f0 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Refreshing network info cache for port 954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-78d70912-0367-420a-8744-e43068e30f96 req-09c6b8e2-ceb4-4483-85a5-bfcf09fee8f0 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updated VIF entry in instance network info cache for port 954e13fe-66db-4b7f-9ff1-ad70f956e95f. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG nova.network.neutron [req-78d70912-0367-420a-8744-e43068e30f96 req-09c6b8e2-ceb4-4483-85a5-bfcf09fee8f0 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updating instance_info_cache with network_info: [{"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:25:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-78d70912-0367-420a-8744-e43068e30f96 req-09c6b8e2-ceb4-4483-85a5-bfcf09fee8f0 service nova] Releasing lock "refresh_cache-09f16ba8-8601-4fbf-a87a-fd84525f99ca" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "06578dba-7003-4d6f-9500-086ba85ebee6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:26 user nova-compute[74963]: INFO nova.compute.manager [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Terminating instance
Nov 30 08:25:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-12c7130d-bf52-4f4f-bb5f-d0d266f0a637 req-188aa63e-d160-48a3-b516-d603b8d1b52d service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-unplugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-12c7130d-bf52-4f4f-bb5f-d0d266f0a637 req-188aa63e-d160-48a3-b516-d603b8d1b52d service nova] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-12c7130d-bf52-4f4f-bb5f-d0d266f0a637 req-188aa63e-d160-48a3-b516-d603b8d1b52d service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-12c7130d-bf52-4f4f-bb5f-d0d266f0a637 req-188aa63e-d160-48a3-b516-d603b8d1b52d service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-12c7130d-bf52-4f4f-bb5f-d0d266f0a637 req-188aa63e-d160-48a3-b516-d603b8d1b52d service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] No waiting events found dispatching network-vif-unplugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:25:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-12c7130d-bf52-4f4f-bb5f-d0d266f0a637 req-188aa63e-d160-48a3-b516-d603b8d1b52d service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-unplugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Instance destroyed successfully.
Nov 30 08:25:27 user nova-compute[74963]: DEBUG nova.objects.instance [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lazy-loading 'resources' on Instance uuid 06578dba-7003-4d6f-9500-086ba85ebee6 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T08:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-811037316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1978623399',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPo15KF1HXLEyPpa+4O3PhxaN/ETMyQMGcI46Pp8izb9WazA93d3bhxCfOy90R6rUR5VCwbkC4GFrn21BszijXxqyFgAYkvjek38GdhPOnd1W1Jq/0lAq/720Jrz55UsQ==',key_name='tempest-keypair-765355062',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c77b6f8fefeb4df5b8da6752ae8d0a90',ramdisk_id='',reservation_id='r-8gmjeasr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1218377200',owner_user_name='tempest-ServerActionsV293TestJSON-1218377200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:24:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38459c26cb7c4d229c2d9bdbfed447cb',uuid=06578dba-7003-4d6f-9500-086ba85ebee6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converting VIF {"id": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "address": "fa:16:3e:fd:07:35", "network": {"id": "3074ce91-f36d-4a88-ba52-bb7d288912c2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-566822805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77b6f8fefeb4df5b8da6752ae8d0a90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e7ed6-0e", "ovs_interfaceid": "355e7ed6-0e7a-430c-8d27-78f8c9bffbfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_vif [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap355e7ed6-0e, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2987c454-5e64-4050-9b2b-f1a3678371c1) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:27 user nova-compute[74963]: INFO os_vif [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:07:35,bridge_name='br-int',has_traffic_filtering=True,id=355e7ed6-0e7a-430c-8d27-78f8c9bffbfd,network=Network(3074ce91-f36d-4a88-ba52-bb7d288912c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e7ed6-0e')
Nov 30 08:25:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REqzrnPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:25:27 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc52b0f-583e-4c78-9c8e-19304e6ab89e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:25:27 user nova-compute[74963]: No targets found.
Nov 30 08:25:27 user nova-compute[74963]: iSNS:
Nov 30 08:25:27 user nova-compute[74963]: No targets found.
Nov 30 08:25:27 user nova-compute[74963]: STATIC:
Nov 30 08:25:27 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a
Nov 30 08:25:27 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:25:27 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:25:27 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7
Nov 30 08:25:27 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:25:27 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:25:27 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:25:27 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:25:27 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:25:27 user nova-compute[74963]: FIRMWARE:
Nov 30 08:25:27 user nova-compute[74963]: No targets found.
Nov 30 08:25:27 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:25:27 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:25:27 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23d6a3-f239-4be8-a086-6b1da1ceebb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dcc9f0-5be5-4e74-9c4e-02f2ab1189b1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:25:27 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:25:27 user nova-compute[74963]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:25:27 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:25:27 user nova-compute[74963]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a (non-flash)
Nov 30 08:25:27 user nova-compute[74963]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:25:27 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624419d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a'): ({'sdc'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Removing single pathed devices sdc {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d617eb1-f7ca-4f3b-99d1-d518e1d4e4b9]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[047ea4ab-1265-4bc7-978f-dc1019061336]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Flushing IO for device /dev/sdc {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87dc8a7-0b2e-4302-bf00-d0a8e7174d96]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[517919e7-1f02-4200-953b-826fd85c447b]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[31326a11-51d1-4172-b4f1-d2078b33b276]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1f790e-7eb0-43bf-9076-ab29c1699cfa]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260]
Nov 30 08:25:27 user nova-compute[74963]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a, portal: 172.16.0.220,3260] successful.
Nov 30 08:25:27 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618fb746-5223-416c-90a6-2fe2225c714a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[77de0dd8-b60c-4be9-98ac-39699dfd2678]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] <== disconnect_volume: return (334ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:25:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Deleting instance files /opt/stack/data/nova/instances/06578dba-7003-4d6f-9500-086ba85ebee6_del
Nov 30 08:25:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Deletion of /opt/stack/data/nova/instances/06578dba-7003-4d6f-9500-086ba85ebee6_del complete
Nov 30 08:25:27 user nova-compute[74963]: INFO nova.compute.manager [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 30 08:25:27 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:25:27 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:25:28 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:25:28 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Took 0.80 seconds to deallocate network for instance.
Nov 30 08:25:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-bdab9795-9318-4a85-9332-084904ff7b40 req-b419917d-b3c0-481c-9e56-12cf56a5e2a4 service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-deleted-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-31ab2a1c-65bb-4db8-b9e6-771e3fd1f6d5 req-5e8bf0a2-f146-49f2-9fda-b60c4cf1b1cb service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-31ab2a1c-65bb-4db8-b9e6-771e3fd1f6d5 req-5e8bf0a2-f146-49f2-9fda-b60c4cf1b1cb service nova] Acquiring lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-31ab2a1c-65bb-4db8-b9e6-771e3fd1f6d5 req-5e8bf0a2-f146-49f2-9fda-b60c4cf1b1cb service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-31ab2a1c-65bb-4db8-b9e6-771e3fd1f6d5 req-5e8bf0a2-f146-49f2-9fda-b60c4cf1b1cb service nova] Lock "06578dba-7003-4d6f-9500-086ba85ebee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-31ab2a1c-65bb-4db8-b9e6-771e3fd1f6d5 req-5e8bf0a2-f146-49f2-9fda-b60c4cf1b1cb service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] No waiting events found dispatching network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:25:28 user nova-compute[74963]: WARNING nova.compute.manager [req-31ab2a1c-65bb-4db8-b9e6-771e3fd1f6d5 req-5e8bf0a2-f146-49f2-9fda-b60c4cf1b1cb service nova] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Received unexpected event network-vif-plugged-355e7ed6-0e7a-430c-8d27-78f8c9bffbfd for instance with vm_state active and task_state deleting.
Nov 30 08:25:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:32 user nova-compute[74963]: INFO nova.compute.manager [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Took 3.81 seconds to detach 1 volumes for instance.
Nov 30 08:25:32 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] [instance: 06578dba-7003-4d6f-9500-086ba85ebee6] Deleting volume: 618fb746-5223-416c-90a6-2fe2225c714a {{(pid=74963) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 08:25:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:32 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:25:32 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:25:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:32 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Deleted allocations for instance 06578dba-7003-4d6f-9500-086ba85ebee6
Nov 30 08:25:32 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bf06564f-73b9-487d-be69-f903bd540174 tempest-ServerActionsV293TestJSON-1218377200 tempest-ServerActionsV293TestJSON-1218377200-project-member] Lock "06578dba-7003-4d6f-9500-086ba85ebee6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.418s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:25:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:25:43 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca is timed out.
Nov 30 08:25:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Successfully detached device vdb from instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca from the live domain config.
Nov 30 08:25:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQTwSgzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:25:43 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cad3a2-4323-49eb-9ce5-32a70c2dbbf6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:25:43 user nova-compute[74963]: No targets found.
Nov 30 08:25:43 user nova-compute[74963]: iSNS:
Nov 30 08:25:43 user nova-compute[74963]: No targets found.
Nov 30 08:25:43 user nova-compute[74963]: STATIC:
Nov 30 08:25:43 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7
Nov 30 08:25:43 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:25:43 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:25:43 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811
Nov 30 08:25:43 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:25:43 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:25:43 user nova-compute[74963]: FIRMWARE:
Nov 30 08:25:43 user nova-compute[74963]: No targets found.
Nov 30 08:25:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:25:43 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:25:43 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5d0fb5-d357-4cc2-be00-6f2cc404d78d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b55c81-f3d7-46d4-8fc4-0b9c1f36e0ac]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:25:43 user nova-compute[74963]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:25:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 (non-flash)
Nov 30 08:25:43 user nova-compute[74963]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:25:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62202f6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da4b75c-4516-448f-93f1-80ab3731e692]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[127f1aeb-a34b-4f81-b3c5-7b8afc63edd2]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5894f8-20a3-4451-8f8a-40f1650bb710]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88df0b8-d7f7-4ef9-9f0a-76a4385c38b7]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f950baf-b9a6-42fe-9fd2-90d4dcc8899a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2d9302-599b-4735-991a-91c19e19eaf0]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811, portal: 172.16.0.220,3260]
Nov 30 08:25:43 user nova-compute[74963]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811, portal: 172.16.0.220,3260] successful.
Nov 30 08:25:43 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d599c96-806d-4363-95be-3d98b1f92811 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ac2ff7-a8b8-46f4-a76e-c81cd6985f25]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] <== disconnect_volume: return (315ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:25:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "68bcb314-8197-4fe6-b986-b2554c822545" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "68bcb314-8197-4fe6-b986-b2554c822545" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "68bcb314-8197-4fe6-b986-b2554c822545-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:44 user nova-compute[74963]: INFO nova.compute.manager [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Terminating instance
Nov 30 08:25:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-991896d8-6337-4907-8e5a-2bbf005a5bbe req-fad2c890-512a-4f5d-990c-5ee985486454 service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received event network-vif-unplugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-991896d8-6337-4907-8e5a-2bbf005a5bbe req-fad2c890-512a-4f5d-990c-5ee985486454 service nova] Acquiring lock "68bcb314-8197-4fe6-b986-b2554c822545-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-991896d8-6337-4907-8e5a-2bbf005a5bbe req-fad2c890-512a-4f5d-990c-5ee985486454 service nova] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-991896d8-6337-4907-8e5a-2bbf005a5bbe req-fad2c890-512a-4f5d-990c-5ee985486454 service nova] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-991896d8-6337-4907-8e5a-2bbf005a5bbe req-fad2c890-512a-4f5d-990c-5ee985486454 service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] No waiting events found dispatching network-vif-unplugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-991896d8-6337-4907-8e5a-2bbf005a5bbe req-fad2c890-512a-4f5d-990c-5ee985486454 service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received event network-vif-unplugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG nova.objects.instance [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'flavor' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe743bad-9867-4005-9dab-f33a640e3f4a tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.775s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Instance destroyed successfully.
Nov 30 08:25:44 user nova-compute[74963]: DEBUG nova.objects.instance [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lazy-loading 'resources' on Instance uuid 68bcb314-8197-4fe6-b986-b2554c822545 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1895878506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1895878506',id=2,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:06:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce233bd757b64de4bd6f6abb3230da01',ramdisk_id='',reservation_id='r-hf8kr2nc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:08:02Z,user_data=None,user_id='4b110fcb508342509690b45e1854eb81',uuid=68bcb314-8197-4fe6-b986-b2554c822545,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converting VIF {"id": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "address": "fa:16:3e:a1:c3:be", "network": {"id": "7028ae59-fcbf-4f8f-888f-1654950c5a03", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1763984941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce233bd757b64de4bd6f6abb3230da01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46a6e7-40", "ovs_interfaceid": "da46a6e7-40cb-41cf-93c3-b55ed9fff992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=da46a6e7-40cb-41cf-93c3-b55ed9fff992,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda46a6e7-40') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG os_vif [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=da46a6e7-40cb-41cf-93c3-b55ed9fff992,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda46a6e7-40') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda46a6e7-40, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8cbd4a4-2db1-462b-89f0-cedd783543d1) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:25:44 user nova-compute[74963]: INFO os_vif [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=da46a6e7-40cb-41cf-93c3-b55ed9fff992,network=Network(7028ae59-fcbf-4f8f-888f-1654950c5a03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda46a6e7-40')
Nov 30 08:25:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Deleting instance files /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545_del
Nov 30 08:25:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Deletion of /opt/stack/data/nova/instances/68bcb314-8197-4fe6-b986-b2554c822545_del complete
Nov 30 08:25:45 user nova-compute[74963]: INFO nova.compute.manager [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 30 08:25:45 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:25:45 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:25:45 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:25:45 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:25:45 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Took 0.48 seconds to deallocate network for instance.
Nov 30 08:25:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:45 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:25:45 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:25:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:45 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Deleted allocations for instance 68bcb314-8197-4fe6-b986-b2554c822545
Nov 30 08:25:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-143a7d20-f545-493b-8fcd-f79af8070164 tempest-ServerBootFromVolumeStableRescueTest-1834985655 tempest-ServerBootFromVolumeStableRescueTest-1834985655-project-member] Lock "68bcb314-8197-4fe6-b986-b2554c822545" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.811s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-287aade1-beaf-4eb9-8bd3-b01544b11cc6 req-9dc47d97-db92-4d89-9fc8-6a60479e6865 service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received event network-vif-plugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-287aade1-beaf-4eb9-8bd3-b01544b11cc6 req-9dc47d97-db92-4d89-9fc8-6a60479e6865 service nova] Acquiring lock "68bcb314-8197-4fe6-b986-b2554c822545-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-287aade1-beaf-4eb9-8bd3-b01544b11cc6 req-9dc47d97-db92-4d89-9fc8-6a60479e6865 service nova] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-287aade1-beaf-4eb9-8bd3-b01544b11cc6 req-9dc47d97-db92-4d89-9fc8-6a60479e6865 service nova] Lock "68bcb314-8197-4fe6-b986-b2554c822545-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-287aade1-beaf-4eb9-8bd3-b01544b11cc6 req-9dc47d97-db92-4d89-9fc8-6a60479e6865 service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] No waiting events found dispatching network-vif-plugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:25:46 user nova-compute[74963]: WARNING nova.compute.manager [req-287aade1-beaf-4eb9-8bd3-b01544b11cc6 req-9dc47d97-db92-4d89-9fc8-6a60479e6865 service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received unexpected event network-vif-plugged-da46a6e7-40cb-41cf-93c3-b55ed9fff992 for instance with vm_state deleted and task_state None.
Nov 30 08:25:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-287aade1-beaf-4eb9-8bd3-b01544b11cc6 req-9dc47d97-db92-4d89-9fc8-6a60479e6865 service nova] [instance: 68bcb314-8197-4fe6-b986-b2554c822545] Received event network-vif-deleted-da46a6e7-40cb-41cf-93c3-b55ed9fff992 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:56 user nova-compute[74963]: INFO nova.compute.manager [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Terminating instance
Nov 30 08:25:56 user nova-compute[74963]: DEBUG nova.compute.manager [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:25:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-e8ff41f9-83d9-47be-97a0-bccbaa0b77a4 req-2d681efb-c9d5-4f6c-b20c-3abc65b77065 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-unplugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e8ff41f9-83d9-47be-97a0-bccbaa0b77a4 req-2d681efb-c9d5-4f6c-b20c-3abc65b77065 service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e8ff41f9-83d9-47be-97a0-bccbaa0b77a4 req-2d681efb-c9d5-4f6c-b20c-3abc65b77065 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e8ff41f9-83d9-47be-97a0-bccbaa0b77a4 req-2d681efb-c9d5-4f6c-b20c-3abc65b77065 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-e8ff41f9-83d9-47be-97a0-bccbaa0b77a4 req-2d681efb-c9d5-4f6c-b20c-3abc65b77065 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-unplugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-e8ff41f9-83d9-47be-97a0-bccbaa0b77a4 req-2d681efb-c9d5-4f6c-b20c-3abc65b77065 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-unplugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:25:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Instance destroyed successfully.
Nov 30 08:25:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'resources' on Instance uuid ddde2d1c-aa4e-4415-ab80-6c5e217aae37 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-947669859',display_name='tempest-AttachVolumeTestJSON-server-947669859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-947669859',id=22,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB89fVSzhtfwm1Lv4FTMQ2ggrdWdEmZEvTquBWG5boPgjeuHpCpNY7WcHKpOKqoOmBzQZB62F68xan1ZQtOg94hSbmIl0OyitqdcaGNNsJ2QLVnxkTze3FfA/yhI2bNjhg==',key_name='tempest-keypair-1328476592',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-ls2r7c4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:24:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=ddde2d1c-aa4e-4415-ab80-6c5e217aae37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "address": "fa:16:3e:c2:ee:25", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf90eb0e-d1", "ovs_interfaceid": "af90eb0e-d1c3-4629-9d1a-1c224e637b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG os_vif [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf90eb0e-d1, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bdfbedf-7955-4a4a-9d3f-e3fcc0b7f560) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:25:57 user nova-compute[74963]: INFO os_vif [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:ee:25,bridge_name='br-int',has_traffic_filtering=True,id=af90eb0e-d1c3-4629-9d1a-1c224e637b11,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf90eb0e-d1')
Nov 30 08:25:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Deleting instance files /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37_del
Nov 30 08:25:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Deletion of /opt/stack/data/nova/instances/ddde2d1c-aa4e-4415-ab80-6c5e217aae37_del complete
Nov 30 08:25:57 user nova-compute[74963]: INFO nova.compute.manager [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 30 08:25:57 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:25:57 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:25:58 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:25:58 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Took 0.82 seconds to deallocate network for instance.
Nov 30 08:25:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-e616728e-db93-48c2-99ac-d69da23b0542 req-f81cfcdb-9784-431c-af90-1df0fcf579a3 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-deleted-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:58 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:25:58 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:25:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:58 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Deleted allocations for instance ddde2d1c-aa4e-4415-ab80-6c5e217aae37
Nov 30 08:25:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-65970a72-983f-420c-80cd-88e083d57821 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.353s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-1c5e57cf-823d-41b6-b6d3-4c76e818457f req-98fc00d2-4095-4f5a-a13c-b9c8e15a8f63 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:25:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1c5e57cf-823d-41b6-b6d3-4c76e818457f req-98fc00d2-4095-4f5a-a13c-b9c8e15a8f63 service nova] Acquiring lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:25:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1c5e57cf-823d-41b6-b6d3-4c76e818457f req-98fc00d2-4095-4f5a-a13c-b9c8e15a8f63 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:25:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1c5e57cf-823d-41b6-b6d3-4c76e818457f req-98fc00d2-4095-4f5a-a13c-b9c8e15a8f63 service nova] Lock "ddde2d1c-aa4e-4415-ab80-6c5e217aae37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:25:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-1c5e57cf-823d-41b6-b6d3-4c76e818457f req-98fc00d2-4095-4f5a-a13c-b9c8e15a8f63 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] No waiting events found dispatching network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:25:59 user nova-compute[74963]: WARNING nova.compute.manager [req-1c5e57cf-823d-41b6-b6d3-4c76e818457f req-98fc00d2-4095-4f5a-a13c-b9c8e15a8f63 service nova] [instance: ddde2d1c-aa4e-4415-ab80-6c5e217aae37] Received unexpected event network-vif-plugged-af90eb0e-d1c3-4629-9d1a-1c224e637b11 for instance with vm_state deleted and task_state None.
Nov 30 08:25:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:26:13 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:13 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8385MB free_disk=25.32351303100586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:13 user nova-compute[74963]: INFO nova.compute.manager [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Terminating instance
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Applying migration context for instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce as it has an incoming, in-progress migration 1c353468-c767-492a-b7bd-065fdccd9d6a. Migration status is finished {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 08:26:13 user nova-compute[74963]: INFO nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating resource usage from migration 1c353468-c767-492a-b7bd-065fdccd9d6a
Nov 30 08:26:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Migration 1c353468-c767-492a-b7bd-065fdccd9d6a is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-d021f90e-1398-4b0f-8a89-38a94330128a req-8824f7b0-2ce9-426c-9ce9-79843d6b407d service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-unplugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d021f90e-1398-4b0f-8a89-38a94330128a req-8824f7b0-2ce9-426c-9ce9-79843d6b407d service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d021f90e-1398-4b0f-8a89-38a94330128a req-8824f7b0-2ce9-426c-9ce9-79843d6b407d service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d021f90e-1398-4b0f-8a89-38a94330128a req-8824f7b0-2ce9-426c-9ce9-79843d6b407d service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-d021f90e-1398-4b0f-8a89-38a94330128a req-8824f7b0-2ce9-426c-9ce9-79843d6b407d service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-unplugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-d021f90e-1398-4b0f-8a89-38a94330128a req-8824f7b0-2ce9-426c-9ce9-79843d6b407d service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-unplugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:26:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Instance destroyed successfully.
Nov 30 08:26:14 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'resources' on Instance uuid 09f16ba8-8601-4fbf-a87a-fd84525f99ca {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1792156780',display_name='tempest-ServerRescueNegativeTestJSON-server-1792156780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1792156780',id=27,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw45HBZ5xU19gc9vrUU/5CeRU2AmyOb8wCG3xs4Xu+gBPBjAO9Y32a7/m95UeqCYXma7Nc/crom/3bi0PJ9GohtwPeZABzy2+eRhQoizkFvRsYJkg+rOrhXUUklTA5pSQ==',key_name='tempest-keypair-330175841',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:21:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-bcymuq0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b068a21b7ee04d14984abc97e582aa63',uuid=09f16ba8-8601-4fbf-a87a-fd84525f99ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "address": "fa:16:3e:7b:7e:2f", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap954e13fe-66", "ovs_interfaceid": "954e13fe-66db-4b7f-9ff1-ad70f956e95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:7e:2f,bridge_name='br-int',has_traffic_filtering=True,id=954e13fe-66db-4b7f-9ff1-ad70f956e95f,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap954e13fe-66') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG os_vif [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:7e:2f,bridge_name='br-int',has_traffic_filtering=True,id=954e13fe-66db-4b7f-9ff1-ad70f956e95f,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap954e13fe-66') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap954e13fe-66, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38fd6edc-0f96-4794-a6d5-b9be5be5a3e5) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:14 user nova-compute[74963]: INFO os_vif [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:7e:2f,bridge_name='br-int',has_traffic_filtering=True,id=954e13fe-66db-4b7f-9ff1-ad70f956e95f,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap954e13fe-66')
Nov 30 08:26:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Deleting instance files /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca_del
Nov 30 08:26:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Deletion of /opt/stack/data/nova/instances/09f16ba8-8601-4fbf-a87a-fd84525f99ca_del complete
Nov 30 08:26:14 user nova-compute[74963]: INFO nova.compute.manager [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 30 08:26:14 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:14 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:15 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:15 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:26:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-d92b3f65-81dd-4a34-b1bd-59c2fd1b0ea1 req-77f9d239-88f3-4dd5-a6a4-57c06fbb4665 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:26:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d92b3f65-81dd-4a34-b1bd-59c2fd1b0ea1 req-77f9d239-88f3-4dd5-a6a4-57c06fbb4665 service nova] Acquiring lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d92b3f65-81dd-4a34-b1bd-59c2fd1b0ea1 req-77f9d239-88f3-4dd5-a6a4-57c06fbb4665 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d92b3f65-81dd-4a34-b1bd-59c2fd1b0ea1 req-77f9d239-88f3-4dd5-a6a4-57c06fbb4665 service nova] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-d92b3f65-81dd-4a34-b1bd-59c2fd1b0ea1 req-77f9d239-88f3-4dd5-a6a4-57c06fbb4665 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] No waiting events found dispatching network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:26:15 user nova-compute[74963]: WARNING nova.compute.manager [req-d92b3f65-81dd-4a34-b1bd-59c2fd1b0ea1 req-77f9d239-88f3-4dd5-a6a4-57c06fbb4665 service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received unexpected event network-vif-plugged-954e13fe-66db-4b7f-9ff1-ad70f956e95f for instance with vm_state active and task_state deleting.
Nov 30 08:26:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:26:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Skipping network cache update for instance because it is being deleted. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 30 08:26:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Didn't find any instances for network info cache update. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 08:26:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:16 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:16 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Took 1.81 seconds to deallocate network for instance.
Nov 30 08:26:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:16 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:26:16 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:26:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:16 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Deleted allocations for instance 09f16ba8-8601-4fbf-a87a-fd84525f99ca
Nov 30 08:26:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d76bbd4a-5a57-4bf7-b1a0-3e74620e122d tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "09f16ba8-8601-4fbf-a87a-fd84525f99ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.215s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-64d3911c-f99d-4ed3-8720-a31cb1ec6a40 req-60c9d664-92a5-4653-895d-f05bb86ed9af service nova] [instance: 09f16ba8-8601-4fbf-a87a-fd84525f99ca] Received event network-vif-deleted-954e13fe-66db-4b7f-9ff1-ad70f956e95f {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:26:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:21 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:26:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:27 user nova-compute[74963]: DEBUG nova.compute.manager [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Going to confirm migration 2 {{(pid=74963) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 30 08:26:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:26:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquired lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:26:27 user nova-compute[74963]: DEBUG nova.network.neutron [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:26:27 user nova-compute[74963]: DEBUG nova.objects.instance [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'info_cache' on Instance uuid 4b7e702a-7148-4e96-bf46-9fe600dc5dce {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:26:28 user nova-compute[74963]: DEBUG nova.network.neutron [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating instance_info_cache with network_info: [{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Releasing lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:26:28 user nova-compute[74963]: DEBUG nova.objects.instance [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'migration_context' on Instance uuid 4b7e702a-7148-4e96-bf46-9fe600dc5dce {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:26:28 user nova-compute[74963]: DEBUG nova.objects.base [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Object Instance<4b7e702a-7148-4e96-bf46-9fe600dc5dce> lazy-loaded attributes: info_cache,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:26:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:28 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:26:28 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:26:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.247s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:28 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Deleted allocation for migration 1c353468-c767-492a-b7bd-065fdccd9d6a
Nov 30 08:26:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-828ce805-12c6-4739-b902-a50599a94f4c tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.433s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "83ed20b9-95bf-4396-adcc-4567d6b287c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:34 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:26:35 user nova-compute[74963]: INFO nova.compute.claims [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Claim successful on node user
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.network.neutron [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:26:35 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.policy [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa0ff65bec754a9c931f9faa50e53077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621629205e28463da81ed0f7a32c34a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:26:35 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Creating image(s)
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "/opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "/opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "/opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk 1073741824" returned: 0 in 0.053s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.167s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Cannot resize image /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Ensure instance console log exists: /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:36 user nova-compute[74963]: DEBUG nova.network.neutron [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Successfully created port: a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.network.neutron [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Successfully updated port: a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "refresh_cache-83ed20b9-95bf-4396-adcc-4567d6b287c8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquired lock "refresh_cache-83ed20b9-95bf-4396-adcc-4567d6b287c8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.network.neutron [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-399b74aa-b62e-4661-b5ad-9536bead16ce req-f2b54fb2-d552-47cc-8ac4-69a3b123ce67 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received event network-changed-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.compute.manager [req-399b74aa-b62e-4661-b5ad-9536bead16ce req-f2b54fb2-d552-47cc-8ac4-69a3b123ce67 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Refreshing instance network info cache due to event network-changed-a3cb7bb5-169e-43a6-9df4-ed3852386c3e. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-399b74aa-b62e-4661-b5ad-9536bead16ce req-f2b54fb2-d552-47cc-8ac4-69a3b123ce67 service nova] Acquiring lock "refresh_cache-83ed20b9-95bf-4396-adcc-4567d6b287c8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.network.neutron [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.network.neutron [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Updating instance_info_cache with network_info: [{"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Releasing lock "refresh_cache-83ed20b9-95bf-4396-adcc-4567d6b287c8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Instance network_info: |[{"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-399b74aa-b62e-4661-b5ad-9536bead16ce req-f2b54fb2-d552-47cc-8ac4-69a3b123ce67 service nova] Acquired lock "refresh_cache-83ed20b9-95bf-4396-adcc-4567d6b287c8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.network.neutron [req-399b74aa-b62e-4661-b5ad-9536bead16ce req-f2b54fb2-d552-47cc-8ac4-69a3b123ce67 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Refreshing network info cache for port a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Start _get_guest_xml network_info=[{"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:26:38 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:38 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-844553487',display_name='tempest-VolumesActionsTest-instance-844553487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-844553487',id=30,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621629205e28463da81ed0f7a32c34a3',ramdisk_id='',reservation_id='r-wn5t93bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-854532865',owner_user_name='tempest-VolumesActionsTest-854532865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:26:35Z,user_data=None,user_id='aa0ff65bec754a9c931f9faa50e53077',uuid=83ed20b9-95bf-4396-adcc-4567d6b287c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converting VIF {"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:01:32,bridge_name='br-int',has_traffic_filtering=True,id=a3cb7bb5-169e-43a6-9df4-ed3852386c3e,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb7bb5-16') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.objects.instance [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lazy-loading 'pci_devices' on Instance uuid 83ed20b9-95bf-4396-adcc-4567d6b287c8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:26:38 user nova-compute[74963]:   <uuid>83ed20b9-95bf-4396-adcc-4567d6b287c8</uuid>
Nov 30 08:26:38 user nova-compute[74963]:   <name>instance-0000001e</name>
Nov 30 08:26:38 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:26:38 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:26:38 user nova-compute[74963]:   <metadata>
Nov 30 08:26:38 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:26:38 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:26:38 user nova-compute[74963]:       <nova:name>tempest-VolumesActionsTest-instance-844553487</nova:name>
Nov 30 08:26:38 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:26:38</nova:creationTime>
Nov 30 08:26:38 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:26:38 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:26:38 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:26:38 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:26:38 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:26:38 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:26:38 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:26:38 user nova-compute[74963]:       <nova:owner>
Nov 30 08:26:38 user nova-compute[74963]:         <nova:user uuid="aa0ff65bec754a9c931f9faa50e53077">tempest-VolumesActionsTest-854532865-project-member</nova:user>
Nov 30 08:26:38 user nova-compute[74963]:         <nova:project uuid="621629205e28463da81ed0f7a32c34a3">tempest-VolumesActionsTest-854532865</nova:project>
Nov 30 08:26:38 user nova-compute[74963]:       </nova:owner>
Nov 30 08:26:38 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:26:38 user nova-compute[74963]:       <nova:ports>
Nov 30 08:26:38 user nova-compute[74963]:         <nova:port uuid="a3cb7bb5-169e-43a6-9df4-ed3852386c3e">
Nov 30 08:26:38 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 08:26:38 user nova-compute[74963]:         </nova:port>
Nov 30 08:26:38 user nova-compute[74963]:       </nova:ports>
Nov 30 08:26:38 user nova-compute[74963]:     </nova:instance>
Nov 30 08:26:38 user nova-compute[74963]:   </metadata>
Nov 30 08:26:38 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:26:38 user nova-compute[74963]:     <system>
Nov 30 08:26:38 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:26:38 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:26:38 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:26:38 user nova-compute[74963]:       <entry name="serial">83ed20b9-95bf-4396-adcc-4567d6b287c8</entry>
Nov 30 08:26:38 user nova-compute[74963]:       <entry name="uuid">83ed20b9-95bf-4396-adcc-4567d6b287c8</entry>
Nov 30 08:26:38 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:26:38 user nova-compute[74963]:     </system>
Nov 30 08:26:38 user nova-compute[74963]:   </sysinfo>
Nov 30 08:26:38 user nova-compute[74963]:   <os>
Nov 30 08:26:38 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:26:38 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:26:38 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:26:38 user nova-compute[74963]:   </os>
Nov 30 08:26:38 user nova-compute[74963]:   <features>
Nov 30 08:26:38 user nova-compute[74963]:     <acpi/>
Nov 30 08:26:38 user nova-compute[74963]:     <apic/>
Nov 30 08:26:38 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:26:38 user nova-compute[74963]:   </features>
Nov 30 08:26:38 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:26:38 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:26:38 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:26:38 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:26:38 user nova-compute[74963]:   </clock>
Nov 30 08:26:38 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:26:38 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:26:38 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:26:38 user nova-compute[74963]:   </cpu>
Nov 30 08:26:38 user nova-compute[74963]:   <devices>
Nov 30 08:26:38 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:26:38 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:26:38 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk"/>
Nov 30 08:26:38 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:26:38 user nova-compute[74963]:     </disk>
Nov 30 08:26:38 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:26:38 user nova-compute[74963]:       <mac address="fa:16:3e:44:01:32"/>
Nov 30 08:26:38 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:26:38 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:26:38 user nova-compute[74963]:       <target dev="tapa3cb7bb5-16"/>
Nov 30 08:26:38 user nova-compute[74963]:     </interface>
Nov 30 08:26:38 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:26:38 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/console.log" append="off"/>
Nov 30 08:26:38 user nova-compute[74963]:     </serial>
Nov 30 08:26:38 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:26:38 user nova-compute[74963]:     <video>
Nov 30 08:26:38 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:26:38 user nova-compute[74963]:     </video>
Nov 30 08:26:38 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:26:38 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:26:38 user nova-compute[74963]:     </rng>
Nov 30 08:26:38 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:26:38 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:26:38 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:26:38 user nova-compute[74963]:     </memballoon>
Nov 30 08:26:38 user nova-compute[74963]:   </devices>
Nov 30 08:26:38 user nova-compute[74963]: </domain>
Nov 30 08:26:38 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-844553487',display_name='tempest-VolumesActionsTest-instance-844553487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-844553487',id=30,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621629205e28463da81ed0f7a32c34a3',ramdisk_id='',reservation_id='r-wn5t93bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-854532865',owner_user_name='tempest-VolumesActionsTest-854532865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:26:35Z,user_data=None,user_id='aa0ff65bec754a9c931f9faa50e53077',uuid=83ed20b9-95bf-4396-adcc-4567d6b287c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converting VIF {"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:01:32,bridge_name='br-int',has_traffic_filtering=True,id=a3cb7bb5-169e-43a6-9df4-ed3852386c3e,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb7bb5-16') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG os_vif [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:01:32,bridge_name='br-int',has_traffic_filtering=True,id=a3cb7bb5-169e-43a6-9df4-ed3852386c3e,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb7bb5-16') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9cc2a21-447f-5ce8-8ddd-d0b2088b3d91', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3cb7bb5-16, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3cb7bb5-16, col_values=(('qos', UUID('6792d482-d3fe-482f-912d-6e4a3bb1b5e6')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3cb7bb5-16, col_values=(('external_ids', {'iface-id': 'a3cb7bb5-169e-43a6-9df4-ed3852386c3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:01:32', 'vm-uuid': '83ed20b9-95bf-4396-adcc-4567d6b287c8'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:38 user nova-compute[74963]: INFO os_vif [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:01:32,bridge_name='br-int',has_traffic_filtering=True,id=a3cb7bb5-169e-43a6-9df4-ed3852386c3e,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb7bb5-16')
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:26:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] No VIF found with MAC fa:16:3e:44:01:32, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:26:39 user nova-compute[74963]: DEBUG nova.network.neutron [req-399b74aa-b62e-4661-b5ad-9536bead16ce req-f2b54fb2-d552-47cc-8ac4-69a3b123ce67 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Updated VIF entry in instance network info cache for port a3cb7bb5-169e-43a6-9df4-ed3852386c3e. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:26:39 user nova-compute[74963]: DEBUG nova.network.neutron [req-399b74aa-b62e-4661-b5ad-9536bead16ce req-f2b54fb2-d552-47cc-8ac4-69a3b123ce67 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Updating instance_info_cache with network_info: [{"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-399b74aa-b62e-4661-b5ad-9536bead16ce req-f2b54fb2-d552-47cc-8ac4-69a3b123ce67 service nova] Releasing lock "refresh_cache-83ed20b9-95bf-4396-adcc-4567d6b287c8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:26:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-f83358d2-fba1-4371-80e4-1a275d5b5449 req-1d0e23c9-1f09-4bd6-aff1-3b8ceb37878f service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received event network-vif-plugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:26:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f83358d2-fba1-4371-80e4-1a275d5b5449 req-1d0e23c9-1f09-4bd6-aff1-3b8ceb37878f service nova] Acquiring lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f83358d2-fba1-4371-80e4-1a275d5b5449 req-1d0e23c9-1f09-4bd6-aff1-3b8ceb37878f service nova] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f83358d2-fba1-4371-80e4-1a275d5b5449 req-1d0e23c9-1f09-4bd6-aff1-3b8ceb37878f service nova] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-f83358d2-fba1-4371-80e4-1a275d5b5449 req-1d0e23c9-1f09-4bd6-aff1-3b8ceb37878f service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] No waiting events found dispatching network-vif-plugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:26:41 user nova-compute[74963]: WARNING nova.compute.manager [req-f83358d2-fba1-4371-80e4-1a275d5b5449 req-1d0e23c9-1f09-4bd6-aff1-3b8ceb37878f service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received unexpected event network-vif-plugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e for instance with vm_state building and task_state spawning.
Nov 30 08:26:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:42 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:26:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:26:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Instance spawned successfully.
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:26:43 user nova-compute[74963]: INFO nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Took 7.54 seconds to spawn the instance on the hypervisor.
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:26:43 user nova-compute[74963]: INFO nova.compute.manager [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Took 8.21 seconds to build instance.
Nov 30 08:26:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b297dc4a-729f-4578-8636-781923dec1fb tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.316s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-5a4a3885-a6c3-4ad9-bb3d-d8a5a04dcb4a req-4ead63f8-e811-4032-b804-ea1843327959 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received event network-vif-plugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5a4a3885-a6c3-4ad9-bb3d-d8a5a04dcb4a req-4ead63f8-e811-4032-b804-ea1843327959 service nova] Acquiring lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5a4a3885-a6c3-4ad9-bb3d-d8a5a04dcb4a req-4ead63f8-e811-4032-b804-ea1843327959 service nova] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-5a4a3885-a6c3-4ad9-bb3d-d8a5a04dcb4a req-4ead63f8-e811-4032-b804-ea1843327959 service nova] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-5a4a3885-a6c3-4ad9-bb3d-d8a5a04dcb4a req-4ead63f8-e811-4032-b804-ea1843327959 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] No waiting events found dispatching network-vif-plugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:26:43 user nova-compute[74963]: WARNING nova.compute.manager [req-5a4a3885-a6c3-4ad9-bb3d-d8a5a04dcb4a req-4ead63f8-e811-4032-b804-ea1843327959 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received unexpected event network-vif-plugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e for instance with vm_state active and task_state None.
Nov 30 08:26:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:26:51 user nova-compute[74963]: INFO nova.compute.claims [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Claim successful on node user
Nov 30 08:26:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:51 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.061s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:26:52 user nova-compute[74963]: INFO nova.compute.claims [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Claim successful on node user
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.network.neutron [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:26:52 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:26:52 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Creating image(s)
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "/opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "/opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "/opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.policy [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '960072c79ce2402d83f2d6fba0bf77de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2164e77b2f554d9b8eecac876545849b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.867s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:26:52 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:26:52 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:26:53 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk 1073741824" returned: 0 in 0.060s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:26:53 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Creating image(s)
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "/opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "/opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "/opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG nova.policy [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faaefd1e3d946eba7123229378d79fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8be2ffbe2e411590d35d9c12196ba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Cannot resize image /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Ensure instance console log exists: /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.219s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk 1073741824" returned: 0 in 0.051s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.238s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Cannot resize image /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Ensure instance console log exists: /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG nova.network.neutron [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Successfully created port: a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:54 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Successfully created port: aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquiring lock "b7df406a-0e31-4216-954e-3d3748e22e98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "b7df406a-0e31-4216-954e-3d3748e22e98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG nova.network.neutron [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Successfully updated port: a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:26:56 user nova-compute[74963]: INFO nova.compute.claims [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Claim successful on node user
Nov 30 08:26:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquired lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG nova.network.neutron [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-df9ad751-3efb-46dd-ba67-45516c576ebe req-b5448dd3-722d-45fb-b436-9e9c6062f629 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received event network-changed-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG nova.compute.manager [req-df9ad751-3efb-46dd-ba67-45516c576ebe req-b5448dd3-722d-45fb-b436-9e9c6062f629 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Refreshing instance network info cache due to event network-changed-a722c418-296f-4f36-ad6c-7b20a43a7a16. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-df9ad751-3efb-46dd-ba67-45516c576ebe req-b5448dd3-722d-45fb-b436-9e9c6062f629 service nova] Acquiring lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Successfully updated port: aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "refresh_cache-09eb9cb2-da5e-4152-a0b8-925f08d221fc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquired lock "refresh_cache-09eb9cb2-da5e-4152-a0b8-925f08d221fc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:26:56 user nova-compute[74963]: DEBUG nova.network.neutron [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.neutron [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:26:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.policy [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bf1a6a3dc4544029814c7fecdf7802d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a04c60b8c9b45309fbdca127e939ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.neutron [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updating instance_info_cache with network_info: [{"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Updating instance_info_cache with network_info: [{"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Releasing lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Instance network_info: |[{"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-df9ad751-3efb-46dd-ba67-45516c576ebe req-b5448dd3-722d-45fb-b436-9e9c6062f629 service nova] Acquired lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.neutron [req-df9ad751-3efb-46dd-ba67-45516c576ebe req-b5448dd3-722d-45fb-b436-9e9c6062f629 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Refreshing network info cache for port a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Start _get_guest_xml network_info=[{"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Releasing lock "refresh_cache-09eb9cb2-da5e-4152-a0b8-925f08d221fc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Instance network_info: |[{"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Start _get_guest_xml network_info=[{"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:26:57 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:57 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:57 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:57 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1868674531',display_name='tempest-AttachVolumeNegativeTest-server-1868674531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1868674531',id=31,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm5hSmQ+GRd8TtmKVQDE5HJfeNYN4Q09jKYvNyyQrjOOX2GDi+Y8xT+SpSPFtDBQkiRHsWQIdvpdQaDp1Zn0UkqViLykNg6Ld+PszzwwKTsVjOxn0wnSOWf5997yipuLg==',key_name='tempest-keypair-1580752985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-v908yxk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=99ad690e-258d-43d1-a217-8b49cf501fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=a722c418-296f-4f36-ad6c-7b20a43a7a16,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722c418-29') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'pci_devices' on Instance uuid 99ad690e-258d-43d1-a217-8b49cf501fa8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1897655427',display_name='tempest-AttachVolumeTestJSON-server-1897655427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1897655427',id=32,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5DkGfom1SzP4SKJ9596qlL39pOJrHnwYhLgyqis4l+MUCgjvv56rJWVCJKGbhOYRpSo6uUzlTNbdXjW3ZocJdxYBFLLlVMsWrYr9YAdQbSIsAqeqD/eUUxBxpdWQ6CgQ==',key_name='tempest-keypair-702226631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-42s3msun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=09eb9cb2-da5e-4152-a0b8-925f08d221fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeb5b7f0-26d2-4990-8d96-f1d699444676,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb5b7f0-26') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'pci_devices' on Instance uuid 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:26:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Creating image(s)
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "/opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "/opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:26:57 user nova-compute[74963]:   <uuid>09eb9cb2-da5e-4152-a0b8-925f08d221fc</uuid>
Nov 30 08:26:57 user nova-compute[74963]:   <name>instance-00000020</name>
Nov 30 08:26:57 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:26:57 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:26:57 user nova-compute[74963]:   <metadata>
Nov 30 08:26:57 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:26:57 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeTestJSON-server-1897655427</nova:name>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:26:57</nova:creationTime>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:26:57 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:26:57 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:owner>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:user uuid="5faaefd1e3d946eba7123229378d79fe">tempest-AttachVolumeTestJSON-1519701713-project-member</nova:user>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:project uuid="df8be2ffbe2e411590d35d9c12196ba8">tempest-AttachVolumeTestJSON-1519701713</nova:project>
Nov 30 08:26:57 user nova-compute[74963]:       </nova:owner>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:ports>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:port uuid="aeb5b7f0-26d2-4990-8d96-f1d699444676">
Nov 30 08:26:57 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 08:26:57 user nova-compute[74963]:         </nova:port>
Nov 30 08:26:57 user nova-compute[74963]:       </nova:ports>
Nov 30 08:26:57 user nova-compute[74963]:     </nova:instance>
Nov 30 08:26:57 user nova-compute[74963]:   </metadata>
Nov 30 08:26:57 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:26:57 user nova-compute[74963]:     <system>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="serial">09eb9cb2-da5e-4152-a0b8-925f08d221fc</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="uuid">09eb9cb2-da5e-4152-a0b8-925f08d221fc</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:26:57 user nova-compute[74963]:     </system>
Nov 30 08:26:57 user nova-compute[74963]:   </sysinfo>
Nov 30 08:26:57 user nova-compute[74963]:   <os>
Nov 30 08:26:57 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:26:57 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:26:57 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:26:57 user nova-compute[74963]:   </os>
Nov 30 08:26:57 user nova-compute[74963]:   <features>
Nov 30 08:26:57 user nova-compute[74963]:     <acpi/>
Nov 30 08:26:57 user nova-compute[74963]:     <apic/>
Nov 30 08:26:57 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:26:57 user nova-compute[74963]:   </features>
Nov 30 08:26:57 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:26:57 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:26:57 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:26:57 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:26:57 user nova-compute[74963]:   </clock>
Nov 30 08:26:57 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:26:57 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:26:57 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:26:57 user nova-compute[74963]:   </cpu>
Nov 30 08:26:57 user nova-compute[74963]:   <devices>
Nov 30 08:26:57 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:26:57 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:26:57 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk"/>
Nov 30 08:26:57 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:26:57 user nova-compute[74963]:     </disk>
Nov 30 08:26:57 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:26:57 user nova-compute[74963]:       <mac address="fa:16:3e:7a:8a:b3"/>
Nov 30 08:26:57 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:26:57 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:26:57 user nova-compute[74963]:       <target dev="tapaeb5b7f0-26"/>
Nov 30 08:26:57 user nova-compute[74963]:     </interface>
Nov 30 08:26:57 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:26:57 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/console.log" append="off"/>
Nov 30 08:26:57 user nova-compute[74963]:     </serial>
Nov 30 08:26:57 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:26:57 user nova-compute[74963]:     <video>
Nov 30 08:26:57 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:26:57 user nova-compute[74963]:     </video>
Nov 30 08:26:57 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:26:57 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:26:57 user nova-compute[74963]:     </rng>
Nov 30 08:26:57 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:26:57 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:26:57 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:26:57 user nova-compute[74963]:     </memballoon>
Nov 30 08:26:57 user nova-compute[74963]:   </devices>
Nov 30 08:26:57 user nova-compute[74963]: </domain>
Nov 30 08:26:57 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1897655427',display_name='tempest-AttachVolumeTestJSON-server-1897655427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1897655427',id=32,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5DkGfom1SzP4SKJ9596qlL39pOJrHnwYhLgyqis4l+MUCgjvv56rJWVCJKGbhOYRpSo6uUzlTNbdXjW3ZocJdxYBFLLlVMsWrYr9YAdQbSIsAqeqD/eUUxBxpdWQ6CgQ==',key_name='tempest-keypair-702226631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-42s3msun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=09eb9cb2-da5e-4152-a0b8-925f08d221fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeb5b7f0-26d2-4990-8d96-f1d699444676,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb5b7f0-26') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG os_vif [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeb5b7f0-26d2-4990-8d96-f1d699444676,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb5b7f0-26') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:26:57 user nova-compute[74963]:   <uuid>99ad690e-258d-43d1-a217-8b49cf501fa8</uuid>
Nov 30 08:26:57 user nova-compute[74963]:   <name>instance-0000001f</name>
Nov 30 08:26:57 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:26:57 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:26:57 user nova-compute[74963]:   <metadata>
Nov 30 08:26:57 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:26:57 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1868674531</nova:name>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:26:57</nova:creationTime>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:26:57 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:26:57 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:owner>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:user uuid="960072c79ce2402d83f2d6fba0bf77de">tempest-AttachVolumeNegativeTest-1676573190-project-member</nova:user>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:project uuid="2164e77b2f554d9b8eecac876545849b">tempest-AttachVolumeNegativeTest-1676573190</nova:project>
Nov 30 08:26:57 user nova-compute[74963]:       </nova:owner>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:26:57 user nova-compute[74963]:       <nova:ports>
Nov 30 08:26:57 user nova-compute[74963]:         <nova:port uuid="a722c418-296f-4f36-ad6c-7b20a43a7a16">
Nov 30 08:26:57 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 08:26:57 user nova-compute[74963]:         </nova:port>
Nov 30 08:26:57 user nova-compute[74963]:       </nova:ports>
Nov 30 08:26:57 user nova-compute[74963]:     </nova:instance>
Nov 30 08:26:57 user nova-compute[74963]:   </metadata>
Nov 30 08:26:57 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:26:57 user nova-compute[74963]:     <system>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="serial">99ad690e-258d-43d1-a217-8b49cf501fa8</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="uuid">99ad690e-258d-43d1-a217-8b49cf501fa8</entry>
Nov 30 08:26:57 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:26:57 user nova-compute[74963]:     </system>
Nov 30 08:26:57 user nova-compute[74963]:   </sysinfo>
Nov 30 08:26:57 user nova-compute[74963]:   <os>
Nov 30 08:26:57 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:26:57 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:26:57 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:26:57 user nova-compute[74963]:   </os>
Nov 30 08:26:57 user nova-compute[74963]:   <features>
Nov 30 08:26:57 user nova-compute[74963]:     <acpi/>
Nov 30 08:26:57 user nova-compute[74963]:     <apic/>
Nov 30 08:26:57 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:26:57 user nova-compute[74963]:   </features>
Nov 30 08:26:57 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:26:57 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:26:57 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:26:57 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:26:57 user nova-compute[74963]:   </clock>
Nov 30 08:26:57 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:26:57 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:26:57 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:26:57 user nova-compute[74963]:   </cpu>
Nov 30 08:26:57 user nova-compute[74963]:   <devices>
Nov 30 08:26:57 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:26:57 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:26:57 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk"/>
Nov 30 08:26:57 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:26:57 user nova-compute[74963]:     </disk>
Nov 30 08:26:57 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:26:57 user nova-compute[74963]:       <mac address="fa:16:3e:ce:79:1a"/>
Nov 30 08:26:57 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:26:57 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:26:57 user nova-compute[74963]:       <target dev="tapa722c418-29"/>
Nov 30 08:26:57 user nova-compute[74963]:     </interface>
Nov 30 08:26:57 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:26:57 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/console.log" append="off"/>
Nov 30 08:26:57 user nova-compute[74963]:     </serial>
Nov 30 08:26:57 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:26:57 user nova-compute[74963]:     <video>
Nov 30 08:26:57 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:26:57 user nova-compute[74963]:     </video>
Nov 30 08:26:57 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:26:57 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:26:57 user nova-compute[74963]:     </rng>
Nov 30 08:26:57 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:26:57 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:26:57 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:26:57 user nova-compute[74963]:     </memballoon>
Nov 30 08:26:57 user nova-compute[74963]:   </devices>
Nov 30 08:26:57 user nova-compute[74963]: </domain>
Nov 30 08:26:57 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1868674531',display_name='tempest-AttachVolumeNegativeTest-server-1868674531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1868674531',id=31,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm5hSmQ+GRd8TtmKVQDE5HJfeNYN4Q09jKYvNyyQrjOOX2GDi+Y8xT+SpSPFtDBQkiRHsWQIdvpdQaDp1Zn0UkqViLykNg6Ld+PszzwwKTsVjOxn0wnSOWf5997yipuLg==',key_name='tempest-keypair-1580752985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-v908yxk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=99ad690e-258d-43d1-a217-8b49cf501fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=a722c418-296f-4f36-ad6c-7b20a43a7a16,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722c418-29') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG os_vif [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=a722c418-296f-4f36-ad6c-7b20a43a7a16,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722c418-29') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80531a1a-2c27-5c96-a4bc-e6b24e715e55', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6ff2819-86ca-57d9-9fce-ad65d6c7fd95', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeb5b7f0-26, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaeb5b7f0-26, col_values=(('qos', UUID('18d666a4-2634-48f1-b314-7601a44fa325')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaeb5b7f0-26, col_values=(('external_ids', {'iface-id': 'aeb5b7f0-26d2-4990-8d96-f1d699444676', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:8a:b3', 'vm-uuid': '09eb9cb2-da5e-4152-a0b8-925f08d221fc'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: INFO os_vif [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeb5b7f0-26d2-4990-8d96-f1d699444676,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb5b7f0-26')
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa722c418-29, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa722c418-29, col_values=(('qos', UUID('633ca8d5-a0d8-40a4-a8bb-017e08f196d6')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa722c418-29, col_values=(('external_ids', {'iface-id': 'a722c418-296f-4f36-ad6c-7b20a43a7a16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:79:1a', 'vm-uuid': '99ad690e-258d-43d1-a217-8b49cf501fa8'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:57 user nova-compute[74963]: INFO os_vif [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=a722c418-296f-4f36-ad6c-7b20a43a7a16,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722c418-29')
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No VIF found with MAC fa:16:3e:7a:8a:b3, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No VIF found with MAC fa:16:3e:ce:79:1a, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.205s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG nova.network.neutron [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Successfully created port: aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.neutron [req-df9ad751-3efb-46dd-ba67-45516c576ebe req-b5448dd3-722d-45fb-b436-9e9c6062f629 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updated VIF entry in instance network info cache for port a722c418-296f-4f36-ad6c-7b20a43a7a16. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.neutron [req-df9ad751-3efb-46dd-ba67-45516c576ebe req-b5448dd3-722d-45fb-b436-9e9c6062f629 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updating instance_info_cache with network_info: [{"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk 1073741824" returned: 0 in 0.056s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-df9ad751-3efb-46dd-ba67-45516c576ebe req-b5448dd3-722d-45fb-b436-9e9c6062f629 service nova] Releasing lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Cannot resize image /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Ensure instance console log exists: /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.neutron [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Successfully updated port: aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquiring lock "refresh_cache-b7df406a-0e31-4216-954e-3d3748e22e98" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquired lock "refresh_cache-b7df406a-0e31-4216-954e-3d3748e22e98" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.neutron [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.neutron [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-9bc7c280-3dca-406c-b354-7a36389398fa req-9dc5cd1c-ffa9-481b-af8c-6ca6cde6823a service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received event network-changed-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-9bc7c280-3dca-406c-b354-7a36389398fa req-9dc5cd1c-ffa9-481b-af8c-6ca6cde6823a service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Refreshing instance network info cache due to event network-changed-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9bc7c280-3dca-406c-b354-7a36389398fa req-9dc5cd1c-ffa9-481b-af8c-6ca6cde6823a service nova] Acquiring lock "refresh_cache-b7df406a-0e31-4216-954e-3d3748e22e98" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.neutron [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Updating instance_info_cache with network_info: [{"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Releasing lock "refresh_cache-b7df406a-0e31-4216-954e-3d3748e22e98" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Instance network_info: |[{"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9bc7c280-3dca-406c-b354-7a36389398fa req-9dc5cd1c-ffa9-481b-af8c-6ca6cde6823a service nova] Acquired lock "refresh_cache-b7df406a-0e31-4216-954e-3d3748e22e98" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.neutron [req-9bc7c280-3dca-406c-b354-7a36389398fa req-9dc5cd1c-ffa9-481b-af8c-6ca6cde6823a service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Refreshing network info cache for port aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Start _get_guest_xml network_info=[{"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:26:58 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:58 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1120581294',display_name='tempest-VolumesActionsTest-instance-1120581294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1120581294',id=33,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a04c60b8c9b45309fbdca127e939ea7',ramdisk_id='',reservation_id='r-443m0667',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1764588645',owner_user_name='tempest-VolumesActionsTest-1764588645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:26:57Z,user_data=None,user_id='4bf1a6a3dc4544029814c7fecdf7802d',uuid=b7df406a-0e31-4216-954e-3d3748e22e98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Converting VIF {"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c,network=Network(478324b4-ed67-4dad-b08c-1aa9ebfaef53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad0bcb7-5e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.objects.instance [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lazy-loading 'pci_devices' on Instance uuid b7df406a-0e31-4216-954e-3d3748e22e98 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:26:58 user nova-compute[74963]:   <uuid>b7df406a-0e31-4216-954e-3d3748e22e98</uuid>
Nov 30 08:26:58 user nova-compute[74963]:   <name>instance-00000021</name>
Nov 30 08:26:58 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:26:58 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:26:58 user nova-compute[74963]:   <metadata>
Nov 30 08:26:58 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:26:58 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:26:58 user nova-compute[74963]:       <nova:name>tempest-VolumesActionsTest-instance-1120581294</nova:name>
Nov 30 08:26:58 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:26:58</nova:creationTime>
Nov 30 08:26:58 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:26:58 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:26:58 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:26:58 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:26:58 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:26:58 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:26:58 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:26:58 user nova-compute[74963]:       <nova:owner>
Nov 30 08:26:58 user nova-compute[74963]:         <nova:user uuid="4bf1a6a3dc4544029814c7fecdf7802d">tempest-VolumesActionsTest-1764588645-project-member</nova:user>
Nov 30 08:26:58 user nova-compute[74963]:         <nova:project uuid="8a04c60b8c9b45309fbdca127e939ea7">tempest-VolumesActionsTest-1764588645</nova:project>
Nov 30 08:26:58 user nova-compute[74963]:       </nova:owner>
Nov 30 08:26:58 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:26:58 user nova-compute[74963]:       <nova:ports>
Nov 30 08:26:58 user nova-compute[74963]:         <nova:port uuid="aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c">
Nov 30 08:26:58 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 08:26:58 user nova-compute[74963]:         </nova:port>
Nov 30 08:26:58 user nova-compute[74963]:       </nova:ports>
Nov 30 08:26:58 user nova-compute[74963]:     </nova:instance>
Nov 30 08:26:58 user nova-compute[74963]:   </metadata>
Nov 30 08:26:58 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:26:58 user nova-compute[74963]:     <system>
Nov 30 08:26:58 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:26:58 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:26:58 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:26:58 user nova-compute[74963]:       <entry name="serial">b7df406a-0e31-4216-954e-3d3748e22e98</entry>
Nov 30 08:26:58 user nova-compute[74963]:       <entry name="uuid">b7df406a-0e31-4216-954e-3d3748e22e98</entry>
Nov 30 08:26:58 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:26:58 user nova-compute[74963]:     </system>
Nov 30 08:26:58 user nova-compute[74963]:   </sysinfo>
Nov 30 08:26:58 user nova-compute[74963]:   <os>
Nov 30 08:26:58 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:26:58 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:26:58 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:26:58 user nova-compute[74963]:   </os>
Nov 30 08:26:58 user nova-compute[74963]:   <features>
Nov 30 08:26:58 user nova-compute[74963]:     <acpi/>
Nov 30 08:26:58 user nova-compute[74963]:     <apic/>
Nov 30 08:26:58 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:26:58 user nova-compute[74963]:   </features>
Nov 30 08:26:58 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:26:58 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:26:58 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:26:58 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:26:58 user nova-compute[74963]:   </clock>
Nov 30 08:26:58 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:26:58 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:26:58 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:26:58 user nova-compute[74963]:   </cpu>
Nov 30 08:26:58 user nova-compute[74963]:   <devices>
Nov 30 08:26:58 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:26:58 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:26:58 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk"/>
Nov 30 08:26:58 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:26:58 user nova-compute[74963]:     </disk>
Nov 30 08:26:58 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:26:58 user nova-compute[74963]:       <mac address="fa:16:3e:a7:39:b4"/>
Nov 30 08:26:58 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:26:58 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:26:58 user nova-compute[74963]:       <target dev="tapaad0bcb7-5e"/>
Nov 30 08:26:58 user nova-compute[74963]:     </interface>
Nov 30 08:26:58 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:26:58 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/console.log" append="off"/>
Nov 30 08:26:58 user nova-compute[74963]:     </serial>
Nov 30 08:26:58 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:26:58 user nova-compute[74963]:     <video>
Nov 30 08:26:58 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:26:58 user nova-compute[74963]:     </video>
Nov 30 08:26:58 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:26:58 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:26:58 user nova-compute[74963]:     </rng>
Nov 30 08:26:58 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:26:58 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:26:58 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:26:58 user nova-compute[74963]:     </memballoon>
Nov 30 08:26:58 user nova-compute[74963]:   </devices>
Nov 30 08:26:58 user nova-compute[74963]: </domain>
Nov 30 08:26:58 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1120581294',display_name='tempest-VolumesActionsTest-instance-1120581294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1120581294',id=33,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a04c60b8c9b45309fbdca127e939ea7',ramdisk_id='',reservation_id='r-443m0667',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1764588645',owner_user_name='tempest-VolumesActionsTest-1764588645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:26:57Z,user_data=None,user_id='4bf1a6a3dc4544029814c7fecdf7802d',uuid=b7df406a-0e31-4216-954e-3d3748e22e98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Converting VIF {"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c,network=Network(478324b4-ed67-4dad-b08c-1aa9ebfaef53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad0bcb7-5e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG os_vif [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c,network=Network(478324b4-ed67-4dad-b08c-1aa9ebfaef53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad0bcb7-5e') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ab28ea7-8078-520c-a478-fd50b4410092', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-798343fb-ae32-476f-beaa-543e75399a58 req-0b4654bd-bd5c-468b-9b34-40dd878a0e5d service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received event network-changed-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.compute.manager [req-798343fb-ae32-476f-beaa-543e75399a58 req-0b4654bd-bd5c-468b-9b34-40dd878a0e5d service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Refreshing instance network info cache due to event network-changed-aeb5b7f0-26d2-4990-8d96-f1d699444676. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-798343fb-ae32-476f-beaa-543e75399a58 req-0b4654bd-bd5c-468b-9b34-40dd878a0e5d service nova] Acquiring lock "refresh_cache-09eb9cb2-da5e-4152-a0b8-925f08d221fc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-798343fb-ae32-476f-beaa-543e75399a58 req-0b4654bd-bd5c-468b-9b34-40dd878a0e5d service nova] Acquired lock "refresh_cache-09eb9cb2-da5e-4152-a0b8-925f08d221fc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG nova.network.neutron [req-798343fb-ae32-476f-beaa-543e75399a58 req-0b4654bd-bd5c-468b-9b34-40dd878a0e5d service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Refreshing network info cache for port aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaad0bcb7-5e, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaad0bcb7-5e, col_values=(('qos', UUID('018213d3-7053-4c51-b73c-408253df2974')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaad0bcb7-5e, col_values=(('external_ids', {'iface-id': 'aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:39:b4', 'vm-uuid': 'b7df406a-0e31-4216-954e-3d3748e22e98'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:26:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:26:58 user nova-compute[74963]: INFO os_vif [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c,network=Network(478324b4-ed67-4dad-b08c-1aa9ebfaef53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad0bcb7-5e')
Nov 30 08:26:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:26:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] No VIF found with MAC fa:16:3e:a7:39:b4, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:26:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-9bc7c280-3dca-406c-b354-7a36389398fa req-9dc5cd1c-ffa9-481b-af8c-6ca6cde6823a service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Updated VIF entry in instance network info cache for port aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:26:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-9bc7c280-3dca-406c-b354-7a36389398fa req-9dc5cd1c-ffa9-481b-af8c-6ca6cde6823a service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Updating instance_info_cache with network_info: [{"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9bc7c280-3dca-406c-b354-7a36389398fa req-9dc5cd1c-ffa9-481b-af8c-6ca6cde6823a service nova] Releasing lock "refresh_cache-b7df406a-0e31-4216-954e-3d3748e22e98" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:26:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-798343fb-ae32-476f-beaa-543e75399a58 req-0b4654bd-bd5c-468b-9b34-40dd878a0e5d service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Updated VIF entry in instance network info cache for port aeb5b7f0-26d2-4990-8d96-f1d699444676. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:26:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-798343fb-ae32-476f-beaa-543e75399a58 req-0b4654bd-bd5c-468b-9b34-40dd878a0e5d service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Updating instance_info_cache with network_info: [{"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:26:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-798343fb-ae32-476f-beaa-543e75399a58 req-0b4654bd-bd5c-468b-9b34-40dd878a0e5d service nova] Releasing lock "refresh_cache-09eb9cb2-da5e-4152-a0b8-925f08d221fc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:26:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-ebaef031-8ca0-4a86-b867-ee0bb1f4377f req-c2a540c5-1b6a-4581-97e7-1c6f5b95c74d service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received event network-vif-plugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ebaef031-8ca0-4a86-b867-ee0bb1f4377f req-c2a540c5-1b6a-4581-97e7-1c6f5b95c74d service nova] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ebaef031-8ca0-4a86-b867-ee0bb1f4377f req-c2a540c5-1b6a-4581-97e7-1c6f5b95c74d service nova] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ebaef031-8ca0-4a86-b867-ee0bb1f4377f req-c2a540c5-1b6a-4581-97e7-1c6f5b95c74d service nova] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-ebaef031-8ca0-4a86-b867-ee0bb1f4377f req-c2a540c5-1b6a-4581-97e7-1c6f5b95c74d service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] No waiting events found dispatching network-vif-plugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:27:01 user nova-compute[74963]: WARNING nova.compute.manager [req-ebaef031-8ca0-4a86-b867-ee0bb1f4377f req-c2a540c5-1b6a-4581-97e7-1c6f5b95c74d service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received unexpected event network-vif-plugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 for instance with vm_state building and task_state spawning.
Nov 30 08:27:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-29123102-dce8-4697-86d5-9a74805429c7 req-45957251-2fcd-47fd-80f6-9b8fd2aaf787 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received event network-vif-plugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-29123102-dce8-4697-86d5-9a74805429c7 req-45957251-2fcd-47fd-80f6-9b8fd2aaf787 service nova] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-29123102-dce8-4697-86d5-9a74805429c7 req-45957251-2fcd-47fd-80f6-9b8fd2aaf787 service nova] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-29123102-dce8-4697-86d5-9a74805429c7 req-45957251-2fcd-47fd-80f6-9b8fd2aaf787 service nova] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-29123102-dce8-4697-86d5-9a74805429c7 req-45957251-2fcd-47fd-80f6-9b8fd2aaf787 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] No waiting events found dispatching network-vif-plugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:27:01 user nova-compute[74963]: WARNING nova.compute.manager [req-29123102-dce8-4697-86d5-9a74805429c7 req-45957251-2fcd-47fd-80f6-9b8fd2aaf787 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received unexpected event network-vif-plugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 for instance with vm_state building and task_state spawning.
Nov 30 08:27:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received event network-vif-plugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] No waiting events found dispatching network-vif-plugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:27:03 user nova-compute[74963]: WARNING nova.compute.manager [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received unexpected event network-vif-plugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 for instance with vm_state building and task_state spawning.
Nov 30 08:27:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received event network-vif-plugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] Acquiring lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] No waiting events found dispatching network-vif-plugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:27:03 user nova-compute[74963]: WARNING nova.compute.manager [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received unexpected event network-vif-plugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c for instance with vm_state building and task_state spawning.
Nov 30 08:27:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received event network-vif-plugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] Acquiring lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] No waiting events found dispatching network-vif-plugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:27:03 user nova-compute[74963]: WARNING nova.compute.manager [req-e7f7cc61-6bbc-4f5c-a866-eaa783981e4b req-741fc8f9-dea8-4b46-ab99-bc827c614cad service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received unexpected event network-vif-plugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c for instance with vm_state building and task_state spawning.
Nov 30 08:27:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-2095f941-0830-43bf-8e9d-504667062eab req-13e4d551-67ca-4736-a3f2-04eb921cbe89 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received event network-vif-plugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2095f941-0830-43bf-8e9d-504667062eab req-13e4d551-67ca-4736-a3f2-04eb921cbe89 service nova] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2095f941-0830-43bf-8e9d-504667062eab req-13e4d551-67ca-4736-a3f2-04eb921cbe89 service nova] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2095f941-0830-43bf-8e9d-504667062eab req-13e4d551-67ca-4736-a3f2-04eb921cbe89 service nova] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-2095f941-0830-43bf-8e9d-504667062eab req-13e4d551-67ca-4736-a3f2-04eb921cbe89 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] No waiting events found dispatching network-vif-plugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:27:03 user nova-compute[74963]: WARNING nova.compute.manager [req-2095f941-0830-43bf-8e9d-504667062eab req-13e4d551-67ca-4736-a3f2-04eb921cbe89 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received unexpected event network-vif-plugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 for instance with vm_state building and task_state spawning.
Nov 30 08:27:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:27:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Instance spawned successfully.
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Instance spawned successfully.
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:27:04 user nova-compute[74963]: INFO nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Took 11.70 seconds to spawn the instance on the hypervisor.
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:27:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Instance spawned successfully.
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:27:04 user nova-compute[74963]: INFO nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Took 11.21 seconds to spawn the instance on the hypervisor.
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:27:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:04 user nova-compute[74963]: INFO nova.compute.manager [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Took 12.93 seconds to build instance.
Nov 30 08:27:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-18760d6c-f535-4ec8-ad0a-0a1200ec97b3 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.044s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:04 user nova-compute[74963]: INFO nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 30 08:27:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:27:04 user nova-compute[74963]: INFO nova.compute.manager [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Took 12.61 seconds to build instance.
Nov 30 08:27:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e05065be-91a4-4069-abce-4dd23e3078ab tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.719s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:04 user nova-compute[74963]: INFO nova.compute.manager [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Took 7.87 seconds to build instance.
Nov 30 08:27:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-bc71b0c3-04ac-4806-b7d9-ac3ef3aea51f tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "b7df406a-0e31-4216-954e-3d3748e22e98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.977s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:13 user nova-compute[74963]: INFO nova.compute.manager [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Terminating instance
Nov 30 08:27:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-87a63239-5289-42d3-a6ac-09d5074341e5 req-6eca396a-f065-4ad9-a872-0d46422bbda4 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-unplugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-87a63239-5289-42d3-a6ac-09d5074341e5 req-6eca396a-f065-4ad9-a872-0d46422bbda4 service nova] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-87a63239-5289-42d3-a6ac-09d5074341e5 req-6eca396a-f065-4ad9-a872-0d46422bbda4 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-87a63239-5289-42d3-a6ac-09d5074341e5 req-6eca396a-f065-4ad9-a872-0d46422bbda4 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-87a63239-5289-42d3-a6ac-09d5074341e5 req-6eca396a-f065-4ad9-a872-0d46422bbda4 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] No waiting events found dispatching network-vif-unplugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG nova.compute.manager [req-87a63239-5289-42d3-a6ac-09d5074341e5 req-6eca396a-f065-4ad9-a872-0d46422bbda4 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-unplugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:27:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Instance destroyed successfully.
Nov 30 08:27:14 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'resources' on Instance uuid e4386623-a0b7-4145-8b84-2a7b64c3a98f {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1896720287',display_name='tempest-ServerRescueNegativeTestJSON-server-1896720287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1896720287',id=16,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:12:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-um1jo7jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:12:59Z,user_data=None,user_id='b068a21b7ee04d14984abc97e582aa63',uuid=e4386623-a0b7-4145-8b84-2a7b64c3a98f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "address": "fa:16:3e:e2:33:a3", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dfabd89-d7", "ovs_interfaceid": "8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dfabd89-d7') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG os_vif [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dfabd89-d7') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8dfabd89-d7, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca09e688-9a7f-415f-9e6d-064322837e02) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:27:14 user nova-compute[74963]: INFO os_vif [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dfabd89-d7')
Nov 30 08:27:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Deleting instance files /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f_del
Nov 30 08:27:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Deletion of /opt/stack/data/nova/instances/e4386623-a0b7-4145-8b84-2a7b64c3a98f_del complete
Nov 30 08:27:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:27:14 user nova-compute[74963]: INFO nova.compute.manager [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 30 08:27:14 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:27:14 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:27:15 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:27:15 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8042MB free_disk=25.307456970214844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance db76a4e1-46a1-4349-a21f-34d43d542349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 83ed20b9-95bf-4396-adcc-4567d6b287c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 99ad690e-258d-43d1-a217-8b49cf501fa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance b7df406a-0e31-4216-954e-3d3748e22e98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing inventories for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating ProviderTree inventory for provider 41961ac9-576a-4a02-a5e7-459f54657b3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating inventory in ProviderTree for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing aggregate associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, aggregates: None {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 08:27:15 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Took 0.90 seconds to deallocate network for instance.
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-5391c6d9-cd99-47b2-b041-77e698e87836 req-6499890c-bc52-4f6f-b281-f2fbc2a1f180 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-deleted-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:27:15 user nova-compute[74963]: INFO nova.compute.manager [req-5391c6d9-cd99-47b2-b041-77e698e87836 req-6499890c-bc52-4f6f-b281-f2fbc2a1f180 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Neutron deleted interface 8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3; detaching it from the instance and deleting it from the info cache
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.network.neutron [req-5391c6d9-cd99-47b2-b041-77e698e87836 req-6499890c-bc52-4f6f-b281-f2fbc2a1f180 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing trait associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-5391c6d9-cd99-47b2-b041-77e698e87836 req-6499890c-bc52-4f6f-b281-f2fbc2a1f180 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Detach interface failed, port_id=8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3, reason: Instance e4386623-a0b7-4145-8b84-2a7b64c3a98f could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-08a708fb-c14e-49c5-bd78-f6ceca229841 req-524a8b01-84f9-4b74-a0d9-ab38b1be1440 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-08a708fb-c14e-49c5-bd78-f6ceca229841 req-524a8b01-84f9-4b74-a0d9-ab38b1be1440 service nova] Acquiring lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-08a708fb-c14e-49c5-bd78-f6ceca229841 req-524a8b01-84f9-4b74-a0d9-ab38b1be1440 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-08a708fb-c14e-49c5-bd78-f6ceca229841 req-524a8b01-84f9-4b74-a0d9-ab38b1be1440 service nova] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-08a708fb-c14e-49c5-bd78-f6ceca229841 req-524a8b01-84f9-4b74-a0d9-ab38b1be1440 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] No waiting events found dispatching network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:27:15 user nova-compute[74963]: WARNING nova.compute.manager [req-08a708fb-c14e-49c5-bd78-f6ceca229841 req-524a8b01-84f9-4b74-a0d9-ab38b1be1440 service nova] [instance: e4386623-a0b7-4145-8b84-2a7b64c3a98f] Received unexpected event network-vif-plugged-8dfabd89-d7a4-4ff9-b4cb-2bb0efbb5be3 for instance with vm_state deleted and task_state None.
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.859s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.356s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:27:16 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:27:16 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:27:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:16 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Deleted allocations for instance e4386623-a0b7-4145-8b84-2a7b64c3a98f
Nov 30 08:27:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f7c07c0d-9fdb-4d66-9df1-777e32619f0b tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "e4386623-a0b7-4145-8b84-2a7b64c3a98f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.871s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:27:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:27:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG nova.objects.instance [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lazy-loading 'info_cache' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updating instance_info_cache with network_info: [{"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-db76a4e1-46a1-4349-a21f-34d43d542349" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:27:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:18 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:21 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74963) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 08:27:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:31 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:27:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 08:27:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] There are 0 instances to clean {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 08:27:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:27:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:27:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:27:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "db76a4e1-46a1-4349-a21f-34d43d542349" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:04 user nova-compute[74963]: INFO nova.compute.manager [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Terminating instance
Nov 30 08:28:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-1c4f6be9-33be-455d-8382-79bd9d29b732 req-633c52bf-0798-4391-83f5-3f6db2d95afa service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1c4f6be9-33be-455d-8382-79bd9d29b732 req-633c52bf-0798-4391-83f5-3f6db2d95afa service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1c4f6be9-33be-455d-8382-79bd9d29b732 req-633c52bf-0798-4391-83f5-3f6db2d95afa service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1c4f6be9-33be-455d-8382-79bd9d29b732 req-633c52bf-0798-4391-83f5-3f6db2d95afa service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-1c4f6be9-33be-455d-8382-79bd9d29b732 req-633c52bf-0798-4391-83f5-3f6db2d95afa service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-1c4f6be9-33be-455d-8382-79bd9d29b732 req-633c52bf-0798-4391-83f5-3f6db2d95afa service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-unplugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:05 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Instance destroyed successfully.
Nov 30 08:28:05 user nova-compute[74963]: DEBUG nova.objects.instance [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lazy-loading 'resources' on Instance uuid db76a4e1-46a1-4349-a21f-34d43d542349 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1360927833',display_name='tempest-ServerRescueNegativeTestJSON-server-1360927833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1360927833',id=15,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:15:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1d09678c8a049bca20bed732eedd231',ramdisk_id='',reservation_id='r-0xtpfyjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1047810333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1047810333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:17:43Z,user_data=None,user_id='b068a21b7ee04d14984abc97e582aa63',uuid=db76a4e1-46a1-4349-a21f-34d43d542349,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converting VIF {"id": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "address": "fa:16:3e:44:b6:0d", "network": {"id": "7cb8b14d-87a7-4e66-a65f-bc665d7051db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764877211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d09678c8a049bca20bed732eedd231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214fb252-a1", "ovs_interfaceid": "214fb252-a1cd-4d60-9439-1a5b9f7e7a0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:b6:0d,bridge_name='br-int',has_traffic_filtering=True,id=214fb252-a1cd-4d60-9439-1a5b9f7e7a0b,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214fb252-a1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG os_vif [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:b6:0d,bridge_name='br-int',has_traffic_filtering=True,id=214fb252-a1cd-4d60-9439-1a5b9f7e7a0b,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214fb252-a1') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap214fb252-a1, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90326770-9c1f-4e95-be50-92f528f5b249) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:28:05 user nova-compute[74963]: INFO os_vif [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:b6:0d,bridge_name='br-int',has_traffic_filtering=True,id=214fb252-a1cd-4d60-9439-1a5b9f7e7a0b,network=Network(7cb8b14d-87a7-4e66-a65f-bc665d7051db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214fb252-a1')
Nov 30 08:28:05 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Deleting instance files /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349_del
Nov 30 08:28:05 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Deletion of /opt/stack/data/nova/instances/db76a4e1-46a1-4349-a21f-34d43d542349_del complete
Nov 30 08:28:05 user nova-compute[74963]: INFO nova.compute.manager [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 30 08:28:05 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:28:05 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Took 0.48 seconds to deallocate network for instance.
Nov 30 08:28:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:28:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:05 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Deleted allocations for instance db76a4e1-46a1-4349-a21f-34d43d542349
Nov 30 08:28:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b51b7223-9b39-43a8-891a-dada74eed465 tempest-ServerRescueNegativeTestJSON-1047810333 tempest-ServerRescueNegativeTestJSON-1047810333-project-member] Lock "db76a4e1-46a1-4349-a21f-34d43d542349" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:06 user nova-compute[74963]: DEBUG nova.compute.manager [req-fcf5d7a3-cedf-4ce2-97c8-f5b0cee2a250 req-818a1c4e-8e74-482d-8020-6c1c2e45b333 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:28:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcf5d7a3-cedf-4ce2-97c8-f5b0cee2a250 req-818a1c4e-8e74-482d-8020-6c1c2e45b333 service nova] Acquiring lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcf5d7a3-cedf-4ce2-97c8-f5b0cee2a250 req-818a1c4e-8e74-482d-8020-6c1c2e45b333 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fcf5d7a3-cedf-4ce2-97c8-f5b0cee2a250 req-818a1c4e-8e74-482d-8020-6c1c2e45b333 service nova] Lock "db76a4e1-46a1-4349-a21f-34d43d542349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:06 user nova-compute[74963]: DEBUG nova.compute.manager [req-fcf5d7a3-cedf-4ce2-97c8-f5b0cee2a250 req-818a1c4e-8e74-482d-8020-6c1c2e45b333 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] No waiting events found dispatching network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:28:06 user nova-compute[74963]: WARNING nova.compute.manager [req-fcf5d7a3-cedf-4ce2-97c8-f5b0cee2a250 req-818a1c4e-8e74-482d-8020-6c1c2e45b333 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received unexpected event network-vif-plugged-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b for instance with vm_state deleted and task_state None.
Nov 30 08:28:06 user nova-compute[74963]: DEBUG nova.compute.manager [req-fcf5d7a3-cedf-4ce2-97c8-f5b0cee2a250 req-818a1c4e-8e74-482d-8020-6c1c2e45b333 service nova] [instance: db76a4e1-46a1-4349-a21f-34d43d542349] Received event network-vif-deleted-214fb252-a1cd-4d60-9439-1a5b9f7e7a0b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:28:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:28:14 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:28:14 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8137MB free_disk=25.279315948486328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 83ed20b9-95bf-4396-adcc-4567d6b287c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 99ad690e-258d-43d1-a217-8b49cf501fa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance b7df406a-0e31-4216-954e-3d3748e22e98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:28:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:28:18 user nova-compute[74963]: INFO nova.compute.manager [None req-bef39692-2edf-4a3b-98f3-e0c2a94cf055 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Get console output
Nov 30 08:28:18 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:18 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:18 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:28:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:28:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:28:18 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:28:18 user nova-compute[74963]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 30 08:28:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updating instance_info_cache with network_info: [{"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:28:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-9feae61e-e897-4fa0-b534-157153e8f6c3" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:28:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:28:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:28:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:21 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "83ed20b9-95bf-4396-adcc-4567d6b287c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:25 user nova-compute[74963]: INFO nova.compute.manager [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Terminating instance
Nov 30 08:28:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-acc91b52-f983-43f9-943a-89d623920142 req-3fbc7a80-32f5-4c15-b67f-af092d0a8885 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received event network-vif-unplugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-acc91b52-f983-43f9-943a-89d623920142 req-3fbc7a80-32f5-4c15-b67f-af092d0a8885 service nova] Acquiring lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-acc91b52-f983-43f9-943a-89d623920142 req-3fbc7a80-32f5-4c15-b67f-af092d0a8885 service nova] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-acc91b52-f983-43f9-943a-89d623920142 req-3fbc7a80-32f5-4c15-b67f-af092d0a8885 service nova] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-acc91b52-f983-43f9-943a-89d623920142 req-3fbc7a80-32f5-4c15-b67f-af092d0a8885 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] No waiting events found dispatching network-vif-unplugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:28:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-acc91b52-f983-43f9-943a-89d623920142 req-3fbc7a80-32f5-4c15-b67f-af092d0a8885 service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received event network-vif-unplugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:28:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Instance destroyed successfully.
Nov 30 08:28:26 user nova-compute[74963]: DEBUG nova.objects.instance [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lazy-loading 'resources' on Instance uuid 83ed20b9-95bf-4396-adcc-4567d6b287c8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-844553487',display_name='tempest-VolumesActionsTest-instance-844553487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-844553487',id=30,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='621629205e28463da81ed0f7a32c34a3',ramdisk_id='',reservation_id='r-wn5t93bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-854532865',owner_user_name='tempest-VolumesActionsTest-854532865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:26:43Z,user_data=None,user_id='aa0ff65bec754a9c931f9faa50e53077',uuid=83ed20b9-95bf-4396-adcc-4567d6b287c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converting VIF {"id": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "address": "fa:16:3e:44:01:32", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb7bb5-16", "ovs_interfaceid": "a3cb7bb5-169e-43a6-9df4-ed3852386c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:01:32,bridge_name='br-int',has_traffic_filtering=True,id=a3cb7bb5-169e-43a6-9df4-ed3852386c3e,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb7bb5-16') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG os_vif [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:01:32,bridge_name='br-int',has_traffic_filtering=True,id=a3cb7bb5-169e-43a6-9df4-ed3852386c3e,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb7bb5-16') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3cb7bb5-16, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6792d482-d3fe-482f-912d-6e4a3bb1b5e6) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:26 user nova-compute[74963]: INFO os_vif [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:01:32,bridge_name='br-int',has_traffic_filtering=True,id=a3cb7bb5-169e-43a6-9df4-ed3852386c3e,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb7bb5-16')
Nov 30 08:28:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Deleting instance files /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8_del
Nov 30 08:28:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Deletion of /opt/stack/data/nova/instances/83ed20b9-95bf-4396-adcc-4567d6b287c8_del complete
Nov 30 08:28:26 user nova-compute[74963]: INFO nova.compute.manager [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 30 08:28:26 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:28:26 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Took 0.54 seconds to deallocate network for instance.
Nov 30 08:28:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:27 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:28:27 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:28:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:27 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Deleted allocations for instance 83ed20b9-95bf-4396-adcc-4567d6b287c8
Nov 30 08:28:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-debffbc1-2b5c-42ff-871a-4d08da22e9c4 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.783s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:27 user nova-compute[74963]: DEBUG nova.compute.manager [req-27916c4f-3691-4366-b0b6-80b6618db537 req-1f623e41-6260-4142-9d97-4ab76cdcfe9a service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received event network-vif-plugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:28:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-27916c4f-3691-4366-b0b6-80b6618db537 req-1f623e41-6260-4142-9d97-4ab76cdcfe9a service nova] Acquiring lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-27916c4f-3691-4366-b0b6-80b6618db537 req-1f623e41-6260-4142-9d97-4ab76cdcfe9a service nova] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-27916c4f-3691-4366-b0b6-80b6618db537 req-1f623e41-6260-4142-9d97-4ab76cdcfe9a service nova] Lock "83ed20b9-95bf-4396-adcc-4567d6b287c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:27 user nova-compute[74963]: DEBUG nova.compute.manager [req-27916c4f-3691-4366-b0b6-80b6618db537 req-1f623e41-6260-4142-9d97-4ab76cdcfe9a service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] No waiting events found dispatching network-vif-plugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:28:27 user nova-compute[74963]: WARNING nova.compute.manager [req-27916c4f-3691-4366-b0b6-80b6618db537 req-1f623e41-6260-4142-9d97-4ab76cdcfe9a service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received unexpected event network-vif-plugged-a3cb7bb5-169e-43a6-9df4-ed3852386c3e for instance with vm_state deleted and task_state None.
Nov 30 08:28:27 user nova-compute[74963]: DEBUG nova.compute.manager [req-27916c4f-3691-4366-b0b6-80b6618db537 req-1f623e41-6260-4142-9d97-4ab76cdcfe9a service nova] [instance: 83ed20b9-95bf-4396-adcc-4567d6b287c8] Received event network-vif-deleted-a3cb7bb5-169e-43a6-9df4-ed3852386c3e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:28:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:28:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:28:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:28:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:28:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-3c2581b3-e5f1-4e23-87e5-f82bf128a736 req-62ee1916-c395-41d0-8a24-24a7a3669bc8 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received event network-changed-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:28:42 user nova-compute[74963]: DEBUG nova.compute.manager [req-3c2581b3-e5f1-4e23-87e5-f82bf128a736 req-62ee1916-c395-41d0-8a24-24a7a3669bc8 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Refreshing instance network info cache due to event network-changed-a722c418-296f-4f36-ad6c-7b20a43a7a16. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:28:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3c2581b3-e5f1-4e23-87e5-f82bf128a736 req-62ee1916-c395-41d0-8a24-24a7a3669bc8 service nova] Acquiring lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:28:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3c2581b3-e5f1-4e23-87e5-f82bf128a736 req-62ee1916-c395-41d0-8a24-24a7a3669bc8 service nova] Acquired lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:28:42 user nova-compute[74963]: DEBUG nova.network.neutron [req-3c2581b3-e5f1-4e23-87e5-f82bf128a736 req-62ee1916-c395-41d0-8a24-24a7a3669bc8 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Refreshing network info cache for port a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG nova.network.neutron [req-3c2581b3-e5f1-4e23-87e5-f82bf128a736 req-62ee1916-c395-41d0-8a24-24a7a3669bc8 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updated VIF entry in instance network info cache for port a722c418-296f-4f36-ad6c-7b20a43a7a16. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG nova.network.neutron [req-3c2581b3-e5f1-4e23-87e5-f82bf128a736 req-62ee1916-c395-41d0-8a24-24a7a3669bc8 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updating instance_info_cache with network_info: [{"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3c2581b3-e5f1-4e23-87e5-f82bf128a736 req-62ee1916-c395-41d0-8a24-24a7a3669bc8 service nova] Releasing lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-d0eb2dd6-09b3-474c-a958-14cdfce12192 req-c590604d-0778-4501-9cb5-0a64b95dd79a service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received event network-changed-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-d0eb2dd6-09b3-474c-a958-14cdfce12192 req-c590604d-0778-4501-9cb5-0a64b95dd79a service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Refreshing instance network info cache due to event network-changed-aeb5b7f0-26d2-4990-8d96-f1d699444676. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d0eb2dd6-09b3-474c-a958-14cdfce12192 req-c590604d-0778-4501-9cb5-0a64b95dd79a service nova] Acquiring lock "refresh_cache-09eb9cb2-da5e-4152-a0b8-925f08d221fc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d0eb2dd6-09b3-474c-a958-14cdfce12192 req-c590604d-0778-4501-9cb5-0a64b95dd79a service nova] Acquired lock "refresh_cache-09eb9cb2-da5e-4152-a0b8-925f08d221fc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG nova.network.neutron [req-d0eb2dd6-09b3-474c-a958-14cdfce12192 req-c590604d-0778-4501-9cb5-0a64b95dd79a service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Refreshing network info cache for port aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG nova.network.neutron [req-d0eb2dd6-09b3-474c-a958-14cdfce12192 req-c590604d-0778-4501-9cb5-0a64b95dd79a service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Updated VIF entry in instance network info cache for port aeb5b7f0-26d2-4990-8d96-f1d699444676. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG nova.network.neutron [req-d0eb2dd6-09b3-474c-a958-14cdfce12192 req-c590604d-0778-4501-9cb5-0a64b95dd79a service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Updating instance_info_cache with network_info: [{"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:28:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d0eb2dd6-09b3-474c-a958-14cdfce12192 req-c590604d-0778-4501-9cb5-0a64b95dd79a service nova] Releasing lock "refresh_cache-09eb9cb2-da5e-4152-a0b8-925f08d221fc" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:28:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG nova.objects.instance [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'flavor' on Instance uuid 99ad690e-258d-43d1-a217-8b49cf501fa8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.283s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:45 user nova-compute[74963]: INFO nova.compute.manager [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Attaching volume 4c844e68-548f-40f4-aeca-aa0e4b608d7a to /dev/vdb
Nov 30 08:28:45 user nova-compute[74963]: DEBUG os_brick.utils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aa862c-f428-4720-8342-d62bbe0d85b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c303b6-b974-4a9b-ae6b-2610ac598fdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a9323-7477-4817-b4e8-9fa80dc162f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca81f66-f772-4591-80b8-fe2f03519275]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:28:45 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58fe0ef-2490-4512-aea6-1489d96e92a1]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG os_brick.utils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updating existing volume attachment record: b45e96e7-3210-41b7-923c-445c829e78e8 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG nova.objects.instance [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:28:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:28:46 user nova-compute[74963]: INFO nova.compute.manager [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Attaching volume 61e48670-4b19-4806-95f7-c4c9e3c87d90 to /dev/vdb
Nov 30 08:28:46 user nova-compute[74963]: DEBUG os_brick.utils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73412fb-c241-4021-92cf-2f2c25a11eda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e34b8-f36c-4cbb-b760-61d78fa5400c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b3da80-9c54-43aa-ae75-8c8a2dffccea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5001f2-0b22-4a04-9b8b-58bce1234404]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:28:46 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:28:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8134c4f3-5521-425c-b41a-1a6a8f2465d0]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG os_brick.utils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Updating existing volume attachment record: fae7e8ef-d5c5-4fd7-a5dc-6ef2700cf927 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:28:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUfgXjYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:28:54 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:28:54 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:28:54 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c032675-c07c-4f84-9a1d-e8c47ca4d42b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:28:54 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d360a3-9d8b-4997-8eda-f1b60b7897e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90] added
Nov 30 08:28:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c32377-56dc-4271-b2dd-c70eb41a6f69]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9d2da-5f94-499e-b309-87c75492ecc1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUfgXjYx {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUfgXjYx" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[93690ba4-afe4-49b1-a44e-54a4edb47c59]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dUfgXjYx'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b06472-4f55-46c6-b7cc-129cec202c3e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[24145e16-08ad-4ef5-b1fd-a04ef900baec]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:28:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:28:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf47f4d-6397-43ab-a4ba-17e26b4d5b90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90, portal: 172.16.0.220,3260]
Nov 30 08:28:54 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90, portal: 172.16.0.220,3260] successful.
Nov 30 08:28:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c406bf9-2b0d-4824-b94e-18d8ba0dde6c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92a3dc3-c511-473a-813f-b4d4e46bd21f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:28:54 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:28:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:28:54 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:28:54 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a96962-da46-4074-ae8a-269e53bcc951]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:28:54 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUfgXjYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FCBGnYMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:28:55 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23664366462313962', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664366462313962', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.153s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:28:55 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:28:55 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG nova.objects.instance [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cbb2e4-94e7-4b2d-85a2-1e63145b39eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:28:55 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:28:55 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:28:55 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:28:55 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:28:55 user nova-compute[74963]:   <serial>61e48670-4b19-4806-95f7-c4c9e3c87d90</serial>
Nov 30 08:28:55 user nova-compute[74963]: </disk>
Nov 30 08:28:55 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1033a275-f6f1-4e24-8e33-f204402eebe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a] added
Nov 30 08:28:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d292fe-2211-4ac5-ae08-876a363cbd7a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[151ea3c8-454d-4763-bf52-7da7996c6d15]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FCBGnYMI {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FCBGnYMI" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[34236692-6d4d-4ef6-a025-b178dc05f97f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FCBGnYMI'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[47943589-5250-4f3b-8214-04c45f252471]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f4ec06-959a-4c1c-9d33-21afe0edcf7e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:28:55 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:28:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:28:55 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:28:55 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:28:55 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd49f9c-bf79-4bb3-81ec-cb0ace092940]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a, portal: 172.16.0.220,3260]
Nov 30 08:28:56 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a, portal: 172.16.0.220,3260] successful.
Nov 30 08:28:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[412bb5e5-2759-4ebf-90e3-db0ad3cf8e31]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d34163a-d4c4-4451-8d89-f75b01cc3457]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:28:56 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:28:56 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:28:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:28:56 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:28:56 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:28:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c065d8ff-c0c1-417a-aaac-a9558ec66770]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FCBGnYMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No VIF found with MAC fa:16:3e:7a:8a:b3, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-255f3777-c4c0-404f-8ee7-526e4e2a5057 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.373s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '26137336532613965', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137336532613965', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'flavor' on Instance uuid 99ad690e-258d-43d1-a217-8b49cf501fa8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:28:57 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:28:57 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:28:57 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:28:57 user nova-compute[74963]:   <serial>4c844e68-548f-40f4-aeca-aa0e4b608d7a</serial>
Nov 30 08:28:57 user nova-compute[74963]: </disk>
Nov 30 08:28:57 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No VIF found with MAC fa:16:3e:ce:79:1a, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:28:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-6843d0ac-2709-4fee-8164-8266956ee5a1 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.161s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:28:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquiring lock "b7df406a-0e31-4216-954e-3d3748e22e98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "b7df406a-0e31-4216-954e-3d3748e22e98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquiring lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:00 user nova-compute[74963]: INFO nova.compute.manager [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Terminating instance
Nov 30 08:29:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:29:00 user nova-compute[74963]: INFO nova.compute.claims [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Claim successful on node user
Nov 30 08:29:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-a4247710-1a4e-4929-a5d8-5d79f5686516 req-b5fd1fde-df6e-4c31-bc50-d8cc69a18f24 service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received event network-vif-unplugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a4247710-1a4e-4929-a5d8-5d79f5686516 req-b5fd1fde-df6e-4c31-bc50-d8cc69a18f24 service nova] Acquiring lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a4247710-1a4e-4929-a5d8-5d79f5686516 req-b5fd1fde-df6e-4c31-bc50-d8cc69a18f24 service nova] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a4247710-1a4e-4929-a5d8-5d79f5686516 req-b5fd1fde-df6e-4c31-bc50-d8cc69a18f24 service nova] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-a4247710-1a4e-4929-a5d8-5d79f5686516 req-b5fd1fde-df6e-4c31-bc50-d8cc69a18f24 service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] No waiting events found dispatching network-vif-unplugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-a4247710-1a4e-4929-a5d8-5d79f5686516 req-b5fd1fde-df6e-4c31-bc50-d8cc69a18f24 service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received event network-vif-unplugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.network.neutron [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:29:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:29:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Instance destroyed successfully.
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.objects.instance [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lazy-loading 'resources' on Instance uuid b7df406a-0e31-4216-954e-3d3748e22e98 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1120581294',display_name='tempest-VolumesActionsTest-instance-1120581294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1120581294',id=33,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a04c60b8c9b45309fbdca127e939ea7',ramdisk_id='',reservation_id='r-443m0667',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1764588645',owner_user_name='tempest-VolumesActionsTest-1764588645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:27:05Z,user_data=None,user_id='4bf1a6a3dc4544029814c7fecdf7802d',uuid=b7df406a-0e31-4216-954e-3d3748e22e98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Converting VIF {"id": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "address": "fa:16:3e:a7:39:b4", "network": {"id": "478324b4-ed67-4dad-b08c-1aa9ebfaef53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450044503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a04c60b8c9b45309fbdca127e939ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad0bcb7-5e", "ovs_interfaceid": "aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c,network=Network(478324b4-ed67-4dad-b08c-1aa9ebfaef53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad0bcb7-5e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG os_vif [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c,network=Network(478324b4-ed67-4dad-b08c-1aa9ebfaef53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad0bcb7-5e') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaad0bcb7-5e, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=018213d3-7053-4c51-b73c-408253df2974) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:01 user nova-compute[74963]: INFO os_vif [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c,network=Network(478324b4-ed67-4dad-b08c-1aa9ebfaef53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad0bcb7-5e')
Nov 30 08:29:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Deleting instance files /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98_del
Nov 30 08:29:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Deletion of /opt/stack/data/nova/instances/b7df406a-0e31-4216-954e-3d3748e22e98_del complete
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.policy [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '960072c79ce2402d83f2d6fba0bf77de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2164e77b2f554d9b8eecac876545849b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:29:01 user nova-compute[74963]: INFO nova.compute.manager [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:29:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Creating image(s)
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "/opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "/opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.434s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:29:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk 1073741824" returned: 0 in 0.078s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Successfully created port: 40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:02 user nova-compute[74963]: INFO nova.compute.manager [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Attaching volume 30429d68-e1e0-42c3-84ec-4a2d4d1b3760 to /dev/vdc
Nov 30 08:29:02 user nova-compute[74963]: DEBUG os_brick.utils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a8d36a-d9b2-415e-904c-d12ba22459dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f006dc08-20f9-4d48-ad5d-c1b26cd79595]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a53142-8a56-4952-b861-27fcc3926711]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a390999-0226-4a8c-89c5-0841a5330153]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.251s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:29:02 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0ada3-04b6-41b8-80b6-976b1c96d585]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:02 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Took 1.03 seconds to deallocate network for instance.
Nov 30 08:29:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG os_brick.utils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Updating existing volume attachment record: 55e13aa1-320a-4874-a826-7cbfeef833bd {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Cannot resize image /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Ensure instance console log exists: /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-1c38dc18-a39e-41b5-b348-3a248f7a7bbd req-61e611db-0ab1-4e39-be44-7527b28d8008 service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received event network-vif-plugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1c38dc18-a39e-41b5-b348-3a248f7a7bbd req-61e611db-0ab1-4e39-be44-7527b28d8008 service nova] Acquiring lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1c38dc18-a39e-41b5-b348-3a248f7a7bbd req-61e611db-0ab1-4e39-be44-7527b28d8008 service nova] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1c38dc18-a39e-41b5-b348-3a248f7a7bbd req-61e611db-0ab1-4e39-be44-7527b28d8008 service nova] Lock "b7df406a-0e31-4216-954e-3d3748e22e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-1c38dc18-a39e-41b5-b348-3a248f7a7bbd req-61e611db-0ab1-4e39-be44-7527b28d8008 service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] No waiting events found dispatching network-vif-plugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:02 user nova-compute[74963]: WARNING nova.compute.manager [req-1c38dc18-a39e-41b5-b348-3a248f7a7bbd req-61e611db-0ab1-4e39-be44-7527b28d8008 service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received unexpected event network-vif-plugged-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c for instance with vm_state deleted and task_state None.
Nov 30 08:29:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-1c38dc18-a39e-41b5-b348-3a248f7a7bbd req-61e611db-0ab1-4e39-be44-7527b28d8008 service nova] [instance: b7df406a-0e31-4216-954e-3d3748e22e98] Received event network-vif-deleted-aad0bcb7-5e3e-4be9-80b5-9c6d89e4650c {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:02 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Deleted allocations for instance b7df406a-0e31-4216-954e-3d3748e22e98
Nov 30 08:29:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1a75cec4-d0d8-47e3-819d-ccef6d58f3aa tempest-VolumesActionsTest-1764588645 tempest-VolumesActionsTest-1764588645-project-member] Lock "b7df406a-0e31-4216-954e-3d3748e22e98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.557s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.network.neutron [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Successfully updated port: 40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "refresh_cache-0a2e6446-42c0-4c91-a31c-6d645ccc9db2" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquired lock "refresh_cache-0a2e6446-42c0-4c91-a31c-6d645ccc9db2" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.network.neutron [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-d958d8ff-29f8-43a6-a055-fa35502010d8 req-bc8ef2f7-42ed-4591-8d07-64c4bbf0c985 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received event network-changed-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.compute.manager [req-d958d8ff-29f8-43a6-a055-fa35502010d8 req-bc8ef2f7-42ed-4591-8d07-64c4bbf0c985 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Refreshing instance network info cache due to event network-changed-40cfb7c1-9e69-4651-81c2-a0b380f8e758. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d958d8ff-29f8-43a6-a055-fa35502010d8 req-bc8ef2f7-42ed-4591-8d07-64c4bbf0c985 service nova] Acquiring lock "refresh_cache-0a2e6446-42c0-4c91-a31c-6d645ccc9db2" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.network.neutron [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.network.neutron [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Updating instance_info_cache with network_info: [{"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Releasing lock "refresh_cache-0a2e6446-42c0-4c91-a31c-6d645ccc9db2" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Instance network_info: |[{"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d958d8ff-29f8-43a6-a055-fa35502010d8 req-bc8ef2f7-42ed-4591-8d07-64c4bbf0c985 service nova] Acquired lock "refresh_cache-0a2e6446-42c0-4c91-a31c-6d645ccc9db2" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.network.neutron [req-d958d8ff-29f8-43a6-a055-fa35502010d8 req-bc8ef2f7-42ed-4591-8d07-64c4bbf0c985 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Refreshing network info cache for port 40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Start _get_guest_xml network_info=[{"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:29:03 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:29:03 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-512583283',display_name='tempest-AttachVolumeNegativeTest-server-512583283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-512583283',id=34,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6obuUXAjVWEltXiO7Htfp+jJcptIQ6wRWmbChIR4apMGsX4r6gLKdOYzJ43nzFJBk1B3pYUHKkFAp5bsjMLULGrtHsnzE8FT7GIvZ7n6aBYTVk0nOnCp/KARCI5Hidmw==',key_name='tempest-keypair-1450796213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-abun1m7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:29:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=0a2e6446-42c0-4c91-a31c-6d645ccc9db2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:d1:d2,bridge_name='br-int',has_traffic_filtering=True,id=40cfb7c1-9e69-4651-81c2-a0b380f8e758,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfb7c1-9e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.objects.instance [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a2e6446-42c0-4c91-a31c-6d645ccc9db2 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:29:03 user nova-compute[74963]:   <uuid>0a2e6446-42c0-4c91-a31c-6d645ccc9db2</uuid>
Nov 30 08:29:03 user nova-compute[74963]:   <name>instance-00000022</name>
Nov 30 08:29:03 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:29:03 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:29:03 user nova-compute[74963]:   <metadata>
Nov 30 08:29:03 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:29:03 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:29:03 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeNegativeTest-server-512583283</nova:name>
Nov 30 08:29:03 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:29:03</nova:creationTime>
Nov 30 08:29:03 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:29:03 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:29:03 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:29:03 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:29:03 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:29:03 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:29:03 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:29:03 user nova-compute[74963]:       <nova:owner>
Nov 30 08:29:03 user nova-compute[74963]:         <nova:user uuid="960072c79ce2402d83f2d6fba0bf77de">tempest-AttachVolumeNegativeTest-1676573190-project-member</nova:user>
Nov 30 08:29:03 user nova-compute[74963]:         <nova:project uuid="2164e77b2f554d9b8eecac876545849b">tempest-AttachVolumeNegativeTest-1676573190</nova:project>
Nov 30 08:29:03 user nova-compute[74963]:       </nova:owner>
Nov 30 08:29:03 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:29:03 user nova-compute[74963]:       <nova:ports>
Nov 30 08:29:03 user nova-compute[74963]:         <nova:port uuid="40cfb7c1-9e69-4651-81c2-a0b380f8e758">
Nov 30 08:29:03 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 08:29:03 user nova-compute[74963]:         </nova:port>
Nov 30 08:29:03 user nova-compute[74963]:       </nova:ports>
Nov 30 08:29:03 user nova-compute[74963]:     </nova:instance>
Nov 30 08:29:03 user nova-compute[74963]:   </metadata>
Nov 30 08:29:03 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:29:03 user nova-compute[74963]:     <system>
Nov 30 08:29:03 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:29:03 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:29:03 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:29:03 user nova-compute[74963]:       <entry name="serial">0a2e6446-42c0-4c91-a31c-6d645ccc9db2</entry>
Nov 30 08:29:03 user nova-compute[74963]:       <entry name="uuid">0a2e6446-42c0-4c91-a31c-6d645ccc9db2</entry>
Nov 30 08:29:03 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:29:03 user nova-compute[74963]:     </system>
Nov 30 08:29:03 user nova-compute[74963]:   </sysinfo>
Nov 30 08:29:03 user nova-compute[74963]:   <os>
Nov 30 08:29:03 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:29:03 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:29:03 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:29:03 user nova-compute[74963]:   </os>
Nov 30 08:29:03 user nova-compute[74963]:   <features>
Nov 30 08:29:03 user nova-compute[74963]:     <acpi/>
Nov 30 08:29:03 user nova-compute[74963]:     <apic/>
Nov 30 08:29:03 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:29:03 user nova-compute[74963]:   </features>
Nov 30 08:29:03 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:29:03 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:29:03 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:29:03 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:29:03 user nova-compute[74963]:   </clock>
Nov 30 08:29:03 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:29:03 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:29:03 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:29:03 user nova-compute[74963]:   </cpu>
Nov 30 08:29:03 user nova-compute[74963]:   <devices>
Nov 30 08:29:03 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:29:03 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:29:03 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk"/>
Nov 30 08:29:03 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:29:03 user nova-compute[74963]:     </disk>
Nov 30 08:29:03 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:29:03 user nova-compute[74963]:       <mac address="fa:16:3e:11:d1:d2"/>
Nov 30 08:29:03 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:29:03 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:29:03 user nova-compute[74963]:       <target dev="tap40cfb7c1-9e"/>
Nov 30 08:29:03 user nova-compute[74963]:     </interface>
Nov 30 08:29:03 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:29:03 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/console.log" append="off"/>
Nov 30 08:29:03 user nova-compute[74963]:     </serial>
Nov 30 08:29:03 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:29:03 user nova-compute[74963]:     <video>
Nov 30 08:29:03 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:29:03 user nova-compute[74963]:     </video>
Nov 30 08:29:03 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:29:03 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:29:03 user nova-compute[74963]:     </rng>
Nov 30 08:29:03 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:29:03 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:29:03 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:29:03 user nova-compute[74963]:     </memballoon>
Nov 30 08:29:03 user nova-compute[74963]:   </devices>
Nov 30 08:29:03 user nova-compute[74963]: </domain>
Nov 30 08:29:03 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-512583283',display_name='tempest-AttachVolumeNegativeTest-server-512583283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-512583283',id=34,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6obuUXAjVWEltXiO7Htfp+jJcptIQ6wRWmbChIR4apMGsX4r6gLKdOYzJ43nzFJBk1B3pYUHKkFAp5bsjMLULGrtHsnzE8FT7GIvZ7n6aBYTVk0nOnCp/KARCI5Hidmw==',key_name='tempest-keypair-1450796213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-abun1m7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:29:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=0a2e6446-42c0-4c91-a31c-6d645ccc9db2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:d1:d2,bridge_name='br-int',has_traffic_filtering=True,id=40cfb7c1-9e69-4651-81c2-a0b380f8e758,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfb7c1-9e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG os_vif [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:d1:d2,bridge_name='br-int',has_traffic_filtering=True,id=40cfb7c1-9e69-4651-81c2-a0b380f8e758,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfb7c1-9e') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fa79e7e-ecb4-5bfa-bd82-779867fd3f8b', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40cfb7c1-9e, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40cfb7c1-9e, col_values=(('qos', UUID('4caff3ae-168b-4964-8473-a2d36818ce2b')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40cfb7c1-9e, col_values=(('external_ids', {'iface-id': '40cfb7c1-9e69-4651-81c2-a0b380f8e758', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:d1:d2', 'vm-uuid': '0a2e6446-42c0-4c91-a31c-6d645ccc9db2'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:29:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:03 user nova-compute[74963]: INFO os_vif [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:d1:d2,bridge_name='br-int',has_traffic_filtering=True,id=40cfb7c1-9e69-4651-81c2-a0b380f8e758,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfb7c1-9e')
Nov 30 08:29:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:29:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No VIF found with MAC fa:16:3e:11:d1:d2, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:29:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-d958d8ff-29f8-43a6-a055-fa35502010d8 req-bc8ef2f7-42ed-4591-8d07-64c4bbf0c985 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Updated VIF entry in instance network info cache for port 40cfb7c1-9e69-4651-81c2-a0b380f8e758. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:29:04 user nova-compute[74963]: DEBUG nova.network.neutron [req-d958d8ff-29f8-43a6-a055-fa35502010d8 req-bc8ef2f7-42ed-4591-8d07-64c4bbf0c985 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Updating instance_info_cache with network_info: [{"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:29:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d958d8ff-29f8-43a6-a055-fa35502010d8 req-bc8ef2f7-42ed-4591-8d07-64c4bbf0c985 service nova] Releasing lock "refresh_cache-0a2e6446-42c0-4c91-a31c-6d645ccc9db2" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:29:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-37551157-ba31-44d7-b0d2-51d6d446ddaf req-cab7b210-80cf-461d-9c9e-ae8318162ae1 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received event network-vif-plugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-37551157-ba31-44d7-b0d2-51d6d446ddaf req-cab7b210-80cf-461d-9c9e-ae8318162ae1 service nova] Acquiring lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-37551157-ba31-44d7-b0d2-51d6d446ddaf req-cab7b210-80cf-461d-9c9e-ae8318162ae1 service nova] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-37551157-ba31-44d7-b0d2-51d6d446ddaf req-cab7b210-80cf-461d-9c9e-ae8318162ae1 service nova] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-37551157-ba31-44d7-b0d2-51d6d446ddaf req-cab7b210-80cf-461d-9c9e-ae8318162ae1 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] No waiting events found dispatching network-vif-plugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:05 user nova-compute[74963]: WARNING nova.compute.manager [req-37551157-ba31-44d7-b0d2-51d6d446ddaf req-cab7b210-80cf-461d-9c9e-ae8318162ae1 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received unexpected event network-vif-plugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 for instance with vm_state building and task_state spawning.
Nov 30 08:29:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:29:07 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Instance spawned successfully.
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:07 user nova-compute[74963]: INFO nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-e4d1eaf4-2f3f-4a22-9ca1-8e6eed531267 req-9d156985-2ac7-42ae-99c5-7b2edb9a9e07 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received event network-vif-plugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e4d1eaf4-2f3f-4a22-9ca1-8e6eed531267 req-9d156985-2ac7-42ae-99c5-7b2edb9a9e07 service nova] Acquiring lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e4d1eaf4-2f3f-4a22-9ca1-8e6eed531267 req-9d156985-2ac7-42ae-99c5-7b2edb9a9e07 service nova] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e4d1eaf4-2f3f-4a22-9ca1-8e6eed531267 req-9d156985-2ac7-42ae-99c5-7b2edb9a9e07 service nova] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:07 user nova-compute[74963]: DEBUG nova.compute.manager [req-e4d1eaf4-2f3f-4a22-9ca1-8e6eed531267 req-9d156985-2ac7-42ae-99c5-7b2edb9a9e07 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] No waiting events found dispatching network-vif-plugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:07 user nova-compute[74963]: WARNING nova.compute.manager [req-e4d1eaf4-2f3f-4a22-9ca1-8e6eed531267 req-9d156985-2ac7-42ae-99c5-7b2edb9a9e07 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received unexpected event network-vif-plugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 for instance with vm_state building and task_state spawning.
Nov 30 08:29:07 user nova-compute[74963]: INFO nova.compute.manager [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Took 7.02 seconds to build instance.
Nov 30 08:29:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-2ecdad84-26ce-48af-a028-cfa7af9245a0 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.152s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrJXUimB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:29:11 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:29:11 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:29:11 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4849d5b2-b550-4825-af7b-8812c4c1516a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:29:11 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b36bc96-62ce-468d-a96d-f4d7b2560626]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760] added
Nov 30 08:29:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b1bf1-584a-4f6c-b00e-1549ee8214b6]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6bc8fd-4478-4da9-93bf-90c81cfafcf7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrJXUimB {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrJXUimB" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e307011e-3816-458b-8351-1d7b700f2ba0]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PrJXUimB'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f765c200-1b00-4462-b5ca-28d7f701753c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d871b406-6147-4a84-a8cb-e5b225fe632e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8cbfd-28dc-4899-a509-959561fec92f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760, portal: 172.16.0.220,3260]
Nov 30 08:29:11 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760, portal: 172.16.0.220,3260] successful.
Nov 30 08:29:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8ba166-7d71-44d2-9686-2131d0f6cfc2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3aa265-571d-4d07-af9e-f4abcb7e8ac7]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:11 user nova-compute[74963]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)
Nov 30 08:29:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a7b6aa-25c7-43e9-a5ee-fca27a4ccb26]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:29:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrJXUimB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:29:12 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:29:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:29:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23930313130336138', 'path': '/dev/sdd'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:29:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930313130336138', 'path': '/dev/sdd'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:29:12 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:29:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:29:12 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:29:12 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:29:12 user nova-compute[74963]:   <target dev="vdc" bus="virtio"/>
Nov 30 08:29:12 user nova-compute[74963]:   <serial>30429d68-e1e0-42c3-84ec-4a2d4d1b3760</serial>
Nov 30 08:29:12 user nova-compute[74963]: </disk>
Nov 30 08:29:12 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:29:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:29:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:29:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:29:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] No VIF found with MAC fa:16:3e:7a:8a:b3, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:29:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8c59cef3-aee0-401e-ab5b-011c2add6133 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.256s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:14 user nova-compute[74963]: INFO nova.compute.manager [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Detaching volume 61e48670-4b19-4806-95f7-c4c9e3c87d90
Nov 30 08:29:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:14 user nova-compute[74963]: INFO nova.virt.block_device [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Attempting to driver detach volume 61e48670-4b19-4806-95f7-c4c9e3c87d90 from mountpoint /dev/vdb
Nov 30 08:29:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Attempting to detach device vdb from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:29:14 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:29:14 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:29:14 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:29:14 user nova-compute[74963]:   <serial>61e48670-4b19-4806-95f7-c4c9e3c87d90</serial>
Nov 30 08:29:14 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:29:14 user nova-compute[74963]: </disk>
Nov 30 08:29:14 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully detached device vdb from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc from the persistent domain config.
Nov 30 08:29:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:29:14 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:29:14 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:29:14 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:29:14 user nova-compute[74963]:   <serial>61e48670-4b19-4806-95f7-c4c9e3c87d90</serial>
Nov 30 08:29:14 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:29:14 user nova-compute[74963]: </disk>
Nov 30 08:29:14 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:29:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:29:16 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:29:16 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8311MB free_disk=25.315441131591797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 99ad690e-258d-43d1-a217-8b49cf501fa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 0a2e6446-42c0-4c91-a31c-6d645ccc9db2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:29:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:29:17 user nova-compute[74963]: INFO nova.compute.claims [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Claim successful on node user
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:29:17 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.policy [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa0ff65bec754a9c931f9faa50e53077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621629205e28463da81ed0f7a32c34a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:29:17 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Creating image(s)
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "/opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "/opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "/opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk 1073741824" returned: 0 in 0.050s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG nova.network.neutron [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Successfully created port: 66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Cannot resize image /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Ensure instance console log exists: /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:29:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Successfully updated port: 66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "refresh_cache-8edb9852-d3f7-491a-a9e3-77d9c0f84588" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquired lock "refresh_cache-8edb9852-d3f7-491a-a9e3-77d9c0f84588" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-9b969d4f-9b32-4f3d-a3c2-5c0274438bc7 req-3a4aa64a-8181-4c71-acd1-dbce74c2059f service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received event network-changed-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-9b969d4f-9b32-4f3d-a3c2-5c0274438bc7 req-3a4aa64a-8181-4c71-acd1-dbce74c2059f service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Refreshing instance network info cache due to event network-changed-66f7751d-a800-4f1c-b7b3-9105546efdbf. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9b969d4f-9b32-4f3d-a3c2-5c0274438bc7 req-3a4aa64a-8181-4c71-acd1-dbce74c2059f service nova] Acquiring lock "refresh_cache-8edb9852-d3f7-491a-a9e3-77d9c0f84588" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating instance_info_cache with network_info: [{"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-4b7e702a-7148-4e96-bf46-9fe600dc5dce" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Updating instance_info_cache with network_info: [{"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Releasing lock "refresh_cache-8edb9852-d3f7-491a-a9e3-77d9c0f84588" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Instance network_info: |[{"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9b969d4f-9b32-4f3d-a3c2-5c0274438bc7 req-3a4aa64a-8181-4c71-acd1-dbce74c2059f service nova] Acquired lock "refresh_cache-8edb9852-d3f7-491a-a9e3-77d9c0f84588" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-9b969d4f-9b32-4f3d-a3c2-5c0274438bc7 req-3a4aa64a-8181-4c71-acd1-dbce74c2059f service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Refreshing network info cache for port 66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Start _get_guest_xml network_info=[{"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:29:19 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:29:19 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-682064681',display_name='tempest-VolumesActionsTest-instance-682064681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-682064681',id=35,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621629205e28463da81ed0f7a32c34a3',ramdisk_id='',reservation_id='r-9dp2a9jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-854532865',owner_user_name='tempest-VolumesActionsTest-854532865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:29:18Z,user_data=None,user_id='aa0ff65bec754a9c931f9faa50e53077',uuid=8edb9852-d3f7-491a-a9e3-77d9c0f84588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converting VIF {"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=66f7751d-a800-4f1c-b7b3-9105546efdbf,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f7751d-a8') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.objects.instance [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lazy-loading 'pci_devices' on Instance uuid 8edb9852-d3f7-491a-a9e3-77d9c0f84588 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:29:19 user nova-compute[74963]:   <uuid>8edb9852-d3f7-491a-a9e3-77d9c0f84588</uuid>
Nov 30 08:29:19 user nova-compute[74963]:   <name>instance-00000023</name>
Nov 30 08:29:19 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:29:19 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:29:19 user nova-compute[74963]:   <metadata>
Nov 30 08:29:19 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:29:19 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:29:19 user nova-compute[74963]:       <nova:name>tempest-VolumesActionsTest-instance-682064681</nova:name>
Nov 30 08:29:19 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:29:19</nova:creationTime>
Nov 30 08:29:19 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:29:19 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:29:19 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:29:19 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:29:19 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:29:19 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:29:19 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:29:19 user nova-compute[74963]:       <nova:owner>
Nov 30 08:29:19 user nova-compute[74963]:         <nova:user uuid="aa0ff65bec754a9c931f9faa50e53077">tempest-VolumesActionsTest-854532865-project-member</nova:user>
Nov 30 08:29:19 user nova-compute[74963]:         <nova:project uuid="621629205e28463da81ed0f7a32c34a3">tempest-VolumesActionsTest-854532865</nova:project>
Nov 30 08:29:19 user nova-compute[74963]:       </nova:owner>
Nov 30 08:29:19 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:29:19 user nova-compute[74963]:       <nova:ports>
Nov 30 08:29:19 user nova-compute[74963]:         <nova:port uuid="66f7751d-a800-4f1c-b7b3-9105546efdbf">
Nov 30 08:29:19 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 08:29:19 user nova-compute[74963]:         </nova:port>
Nov 30 08:29:19 user nova-compute[74963]:       </nova:ports>
Nov 30 08:29:19 user nova-compute[74963]:     </nova:instance>
Nov 30 08:29:19 user nova-compute[74963]:   </metadata>
Nov 30 08:29:19 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:29:19 user nova-compute[74963]:     <system>
Nov 30 08:29:19 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:29:19 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:29:19 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:29:19 user nova-compute[74963]:       <entry name="serial">8edb9852-d3f7-491a-a9e3-77d9c0f84588</entry>
Nov 30 08:29:19 user nova-compute[74963]:       <entry name="uuid">8edb9852-d3f7-491a-a9e3-77d9c0f84588</entry>
Nov 30 08:29:19 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:29:19 user nova-compute[74963]:     </system>
Nov 30 08:29:19 user nova-compute[74963]:   </sysinfo>
Nov 30 08:29:19 user nova-compute[74963]:   <os>
Nov 30 08:29:19 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:29:19 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:29:19 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:29:19 user nova-compute[74963]:   </os>
Nov 30 08:29:19 user nova-compute[74963]:   <features>
Nov 30 08:29:19 user nova-compute[74963]:     <acpi/>
Nov 30 08:29:19 user nova-compute[74963]:     <apic/>
Nov 30 08:29:19 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:29:19 user nova-compute[74963]:   </features>
Nov 30 08:29:19 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:29:19 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:29:19 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:29:19 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:29:19 user nova-compute[74963]:   </clock>
Nov 30 08:29:19 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:29:19 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:29:19 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:29:19 user nova-compute[74963]:   </cpu>
Nov 30 08:29:19 user nova-compute[74963]:   <devices>
Nov 30 08:29:19 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:29:19 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:29:19 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk"/>
Nov 30 08:29:19 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:29:19 user nova-compute[74963]:     </disk>
Nov 30 08:29:19 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:29:19 user nova-compute[74963]:       <mac address="fa:16:3e:5d:3c:b5"/>
Nov 30 08:29:19 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:29:19 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:29:19 user nova-compute[74963]:       <target dev="tap66f7751d-a8"/>
Nov 30 08:29:19 user nova-compute[74963]:     </interface>
Nov 30 08:29:19 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:29:19 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/console.log" append="off"/>
Nov 30 08:29:19 user nova-compute[74963]:     </serial>
Nov 30 08:29:19 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:29:19 user nova-compute[74963]:     <video>
Nov 30 08:29:19 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:29:19 user nova-compute[74963]:     </video>
Nov 30 08:29:19 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:29:19 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:29:19 user nova-compute[74963]:     </rng>
Nov 30 08:29:19 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:29:19 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:29:19 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:29:19 user nova-compute[74963]:     </memballoon>
Nov 30 08:29:19 user nova-compute[74963]:   </devices>
Nov 30 08:29:19 user nova-compute[74963]: </domain>
Nov 30 08:29:19 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-682064681',display_name='tempest-VolumesActionsTest-instance-682064681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-682064681',id=35,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621629205e28463da81ed0f7a32c34a3',ramdisk_id='',reservation_id='r-9dp2a9jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-854532865',owner_user_name='tempest-VolumesActionsTest-854532865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:29:18Z,user_data=None,user_id='aa0ff65bec754a9c931f9faa50e53077',uuid=8edb9852-d3f7-491a-a9e3-77d9c0f84588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converting VIF {"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=66f7751d-a800-4f1c-b7b3-9105546efdbf,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f7751d-a8') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG os_vif [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=66f7751d-a800-4f1c-b7b3-9105546efdbf,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f7751d-a8') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea0c3d74-27f5-5e14-bc21-601328d8f8f6', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66f7751d-a8, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66f7751d-a8, col_values=(('qos', UUID('7647faa3-6703-4646-b7e2-6bd73f82f9b2')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66f7751d-a8, col_values=(('external_ids', {'iface-id': '66f7751d-a800-4f1c-b7b3-9105546efdbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:3c:b5', 'vm-uuid': '8edb9852-d3f7-491a-a9e3-77d9c0f84588'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:19 user nova-compute[74963]: INFO os_vif [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=66f7751d-a800-4f1c-b7b3-9105546efdbf,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f7751d-a8')
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] No VIF found with MAC fa:16:3e:5d:3c:b5, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-9b969d4f-9b32-4f3d-a3c2-5c0274438bc7 req-3a4aa64a-8181-4c71-acd1-dbce74c2059f service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Updated VIF entry in instance network info cache for port 66f7751d-a800-4f1c-b7b3-9105546efdbf. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-9b969d4f-9b32-4f3d-a3c2-5c0274438bc7 req-3a4aa64a-8181-4c71-acd1-dbce74c2059f service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Updating instance_info_cache with network_info: [{"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:29:19 user nova-compute[74963]: INFO nova.compute.manager [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Terminating instance
Nov 30 08:29:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:29:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9b969d4f-9b32-4f3d-a3c2-5c0274438bc7 req-3a4aa64a-8181-4c71-acd1-dbce74c2059f service nova] Releasing lock "refresh_cache-8edb9852-d3f7-491a-a9e3-77d9c0f84588" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-067099e2-5307-4733-875f-e6ab52f648a1 req-4e36a5e7-e1ec-4dc4-ac7e-59f7eed7e078 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-unplugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-067099e2-5307-4733-875f-e6ab52f648a1 req-4e36a5e7-e1ec-4dc4-ac7e-59f7eed7e078 service nova] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-067099e2-5307-4733-875f-e6ab52f648a1 req-4e36a5e7-e1ec-4dc4-ac7e-59f7eed7e078 service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-067099e2-5307-4733-875f-e6ab52f648a1 req-4e36a5e7-e1ec-4dc4-ac7e-59f7eed7e078 service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-067099e2-5307-4733-875f-e6ab52f648a1 req-4e36a5e7-e1ec-4dc4-ac7e-59f7eed7e078 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] No waiting events found dispatching network-vif-unplugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-067099e2-5307-4733-875f-e6ab52f648a1 req-4e36a5e7-e1ec-4dc4-ac7e-59f7eed7e078 service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-unplugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:29:21 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Instance destroyed successfully.
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.objects.instance [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'resources' on Instance uuid 4b7e702a-7148-4e96-bf46-9fe600dc5dce {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-458762508',display_name='tempest-ServerActionsTestOtherA-server-458762508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-458762508',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsWMnq1ufqR++qStn5b43QWm222qTuytohSz8l1/sudpdFVTZkwiTwMp7sHBCXTNfQV4IhtlWVxhMZmDIqgf0oPJwcUspQxqKKVyuXcOkB5qHVJX6ziQnRILaSQcb0Pg==',key_name='tempest-keypair-537501141',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-m1zjngta',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=4b7e702a-7148-4e96-bf46-9fe600dc5dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "address": "fa:16:3e:9b:11:4a", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235245f2-5c", "ovs_interfaceid": "235245f2-5cdc-4b02-8941-beafefbcd5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_vif [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap235245f2-5c, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ea59d57-e940-4223-bfc6-78750844690a) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:29:21 user nova-compute[74963]: INFO os_vif [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=235245f2-5cdc-4b02-8941-beafefbcd5e2,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235245f2-5c')
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZniHaxqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:29:21 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34a9ceb-36f8-476a-bd47-b0c4a3ca4803]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:29:21 user nova-compute[74963]: No targets found.
Nov 30 08:29:21 user nova-compute[74963]: iSNS:
Nov 30 08:29:21 user nova-compute[74963]: No targets found.
Nov 30 08:29:21 user nova-compute[74963]: STATIC:
Nov 30 08:29:21 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90
Nov 30 08:29:21 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:29:21 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:29:21 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a
Nov 30 08:29:21 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:29:21 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:29:21 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7
Nov 30 08:29:21 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:29:21 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:29:21 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760
Nov 30 08:29:21 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:29:21 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:29:21 user nova-compute[74963]: FIRMWARE:
Nov 30 08:29:21 user nova-compute[74963]: No targets found.
Nov 30 08:29:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:29:21 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:29:21 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a307f08-7f74-4504-8d5f-9400b83ecf8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a35b7d-c9fc-4a21-befe-995925f32bb2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:29:21 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:29:21 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:21 user nova-compute[74963]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)
Nov 30 08:29:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 (non-flash)
Nov 30 08:29:21 user nova-compute[74963]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:29:21 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:21 user nova-compute[74963]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)
Nov 30 08:29:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62201c97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7'): ({'sde'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Removing single pathed devices sde {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b89bc-5ddc-44c8-906f-5048290ba50c]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-10be9556-b0c9-45f9-9a69-ab56b3386215 req-cdcdacf1-021c-4058-a84b-a436ae90f279 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received event network-vif-plugged-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-10be9556-b0c9-45f9-9a69-ab56b3386215 req-cdcdacf1-021c-4058-a84b-a436ae90f279 service nova] Acquiring lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-10be9556-b0c9-45f9-9a69-ab56b3386215 req-cdcdacf1-021c-4058-a84b-a436ae90f279 service nova] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-10be9556-b0c9-45f9-9a69-ab56b3386215 req-cdcdacf1-021c-4058-a84b-a436ae90f279 service nova] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-10be9556-b0c9-45f9-9a69-ab56b3386215 req-cdcdacf1-021c-4058-a84b-a436ae90f279 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] No waiting events found dispatching network-vif-plugged-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:21 user nova-compute[74963]: WARNING nova.compute.manager [req-10be9556-b0c9-45f9-9a69-ab56b3386215 req-cdcdacf1-021c-4058-a84b-a436ae90f279 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received unexpected event network-vif-plugged-66f7751d-a800-4f1c-b7b3-9105546efdbf for instance with vm_state building and task_state spawning.
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea87297-85b9-49d1-87f9-300908688d19]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Flushing IO for device /dev/sde {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69101dfa-fdd7-42a6-bd38-861d357bfe42]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b82df-fe5e-4b79-a5ba-26dbf69ff90b]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cc9674-c8f2-4114-9fe5-a84f86296aca]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[88701fc9-6d7f-44c6-905c-729aedac2013]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260]
Nov 30 08:29:21 user nova-compute[74963]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7, portal: 172.16.0.220,3260] successful.
Nov 30 08:29:21 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad36f73-d092-4acf-aac7-0969e77ebeb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b13c076-a4a2-45fa-900d-cccaa0e7cb91]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] <== disconnect_volume: return (426ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:29:21 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Deleting instance files /opt/stack/data/nova/instances/4b7e702a-7148-4e96-bf46-9fe600dc5dce_del
Nov 30 08:29:21 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Deletion of /opt/stack/data/nova/instances/4b7e702a-7148-4e96-bf46-9fe600dc5dce_del complete
Nov 30 08:29:21 user nova-compute[74963]: INFO nova.compute.manager [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Took 1.94 seconds to destroy the instance on the hypervisor.
Nov 30 08:29:21 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:22 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:29:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-38ac284c-8639-4628-be9f-f5bc6dab1ace req-343fee1f-9ad5-4b08-84ae-209072b11adb service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-38ac284c-8639-4628-be9f-f5bc6dab1ace req-343fee1f-9ad5-4b08-84ae-209072b11adb service nova] Acquiring lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-38ac284c-8639-4628-be9f-f5bc6dab1ace req-343fee1f-9ad5-4b08-84ae-209072b11adb service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-38ac284c-8639-4628-be9f-f5bc6dab1ace req-343fee1f-9ad5-4b08-84ae-209072b11adb service nova] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-38ac284c-8639-4628-be9f-f5bc6dab1ace req-343fee1f-9ad5-4b08-84ae-209072b11adb service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] No waiting events found dispatching network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:22 user nova-compute[74963]: WARNING nova.compute.manager [req-38ac284c-8639-4628-be9f-f5bc6dab1ace req-343fee1f-9ad5-4b08-84ae-209072b11adb service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received unexpected event network-vif-plugged-235245f2-5cdc-4b02-8941-beafefbcd5e2 for instance with vm_state active and task_state deleting.
Nov 30 08:29:22 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:29:22 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Took 0.82 seconds to deallocate network for instance.
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:29:23 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Instance spawned successfully.
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:29:23 user nova-compute[74963]: INFO nova.compute.manager [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Took 0.82 seconds to detach 1 volumes for instance.
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Deleting volume: 1ad36f73-d092-4acf-aac7-0969e77ebeb7 {{(pid=74963) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-3efd7d60-25c1-4fbb-be29-d83fc6f2ae39 req-6d88553c-6c05-47e8-add0-3bb79bd3379c service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received event network-vif-plugged-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3efd7d60-25c1-4fbb-be29-d83fc6f2ae39 req-6d88553c-6c05-47e8-add0-3bb79bd3379c service nova] Acquiring lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3efd7d60-25c1-4fbb-be29-d83fc6f2ae39 req-6d88553c-6c05-47e8-add0-3bb79bd3379c service nova] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3efd7d60-25c1-4fbb-be29-d83fc6f2ae39 req-6d88553c-6c05-47e8-add0-3bb79bd3379c service nova] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-3efd7d60-25c1-4fbb-be29-d83fc6f2ae39 req-6d88553c-6c05-47e8-add0-3bb79bd3379c service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] No waiting events found dispatching network-vif-plugged-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:23 user nova-compute[74963]: WARNING nova.compute.manager [req-3efd7d60-25c1-4fbb-be29-d83fc6f2ae39 req-6d88553c-6c05-47e8-add0-3bb79bd3379c service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received unexpected event network-vif-plugged-66f7751d-a800-4f1c-b7b3-9105546efdbf for instance with vm_state building and task_state spawning.
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-3efd7d60-25c1-4fbb-be29-d83fc6f2ae39 req-6d88553c-6c05-47e8-add0-3bb79bd3379c service nova] [instance: 4b7e702a-7148-4e96-bf46-9fe600dc5dce] Received event network-vif-deleted-235245f2-5cdc-4b02-8941-beafefbcd5e2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:23 user nova-compute[74963]: INFO nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 30 08:29:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:23 user nova-compute[74963]: INFO nova.compute.manager [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Took 6.78 seconds to build instance.
Nov 30 08:29:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-05457140-2668-46f7-a3a4-fe199be48dd9 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.923s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:24 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:29:24 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:29:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:24 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Deleted allocations for instance 4b7e702a-7148-4e96-bf46-9fe600dc5dce
Nov 30 08:29:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-66ad3f58-a8c7-4300-add4-a2e34dbff2a9 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "4b7e702a-7148-4e96-bf46-9fe600dc5dce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.351s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:35 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc is timed out.
Nov 30 08:29:35 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully detached device vdb from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc from the live domain config.
Nov 30 08:29:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUfgXjYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:29:35 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[890208b9-c210-4838-b14a-8523e8b71322]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:29:35 user nova-compute[74963]: No targets found.
Nov 30 08:29:35 user nova-compute[74963]: iSNS:
Nov 30 08:29:35 user nova-compute[74963]: No targets found.
Nov 30 08:29:35 user nova-compute[74963]: STATIC:
Nov 30 08:29:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90
Nov 30 08:29:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:29:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:29:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a
Nov 30 08:29:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:29:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:29:35 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760
Nov 30 08:29:35 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:29:35 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:29:35 user nova-compute[74963]: FIRMWARE:
Nov 30 08:29:35 user nova-compute[74963]: No targets found.
Nov 30 08:29:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:29:35 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:29:35 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dda1335-5261-4db1-86c4-24c9dfaa3e14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd411f3e-555d-4a17-9b8b-ed5fd0b929eb]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:29:35 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:35 user nova-compute[74963]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)
Nov 30 08:29:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 (non-flash)
Nov 30 08:29:35 user nova-compute[74963]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:35 user nova-compute[74963]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)
Nov 30 08:29:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6220798550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfe71ef-471a-487e-bb8d-43506d7ecd6d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bee2bf-59cc-40c0-be49-84db2b38374b]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef00d375-6ebb-48db-ba9c-1e072f90dbab]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0788b85e-4e90-4dbf-86a9-29eab26adebf]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ff93f6-3208-4842-b748-cf697e3757a6]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c93294-bf6a-4360-9bca-7867b6dacb9f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90, portal: 172.16.0.220,3260]
Nov 30 08:29:35 user nova-compute[74963]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90, portal: 172.16.0.220,3260] successful.
Nov 30 08:29:35 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e48670-4b19-4806-95f7-c4c9e3c87d90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e3d849-52fd-491c-8a62-c81168447624]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== disconnect_volume: return (290ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:29:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:29:36 user nova-compute[74963]: DEBUG nova.objects.instance [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:29:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-682be17e-21a8-4347-abb3-6dccfc7dd94b tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.858s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:37 user nova-compute[74963]: INFO nova.compute.manager [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Detaching volume 30429d68-e1e0-42c3-84ec-4a2d4d1b3760
Nov 30 08:29:37 user nova-compute[74963]: INFO nova.virt.block_device [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Attempting to driver detach volume 30429d68-e1e0-42c3-84ec-4a2d4d1b3760 from mountpoint /dev/vdc
Nov 30 08:29:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Attempting to detach device vdc from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:29:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:29:37 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:29:37 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:29:37 user nova-compute[74963]:   <target dev="vdc" bus="virtio"/>
Nov 30 08:29:37 user nova-compute[74963]:   <serial>30429d68-e1e0-42c3-84ec-4a2d4d1b3760</serial>
Nov 30 08:29:37 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 08:29:37 user nova-compute[74963]: </disk>
Nov 30 08:29:37 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:29:37 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully detached device vdc from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc from the persistent domain config.
Nov 30 08:29:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:29:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:29:37 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:29:37 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:29:37 user nova-compute[74963]:   <target dev="vdc" bus="virtio"/>
Nov 30 08:29:37 user nova-compute[74963]:   <serial>30429d68-e1e0-42c3-84ec-4a2d4d1b3760</serial>
Nov 30 08:29:37 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 08:29:37 user nova-compute[74963]: </disk>
Nov 30 08:29:37 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:29:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:29:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquiring lock "fe94a683-8d67-48e0-922f-41b9d90007e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:29:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:52 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:29:52 user nova-compute[74963]: INFO nova.compute.claims [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Claim successful on node user
Nov 30 08:29:53 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG nova.network.neutron [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:29:53 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:29:53 user nova-compute[74963]: DEBUG nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:29:53 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Creating image(s)
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "/opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "/opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG nova.policy [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e43ff694ce34909994e9bb3d04b0f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2cd47bda3841648212c2a6ffcb650b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk 1073741824" returned: 0 in 0.080s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.network.neutron [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Successfully created port: fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Cannot resize image /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Ensure instance console log exists: /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.network.neutron [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Successfully updated port: fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquiring lock "refresh_cache-fe94a683-8d67-48e0-922f-41b9d90007e1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquired lock "refresh_cache-fe94a683-8d67-48e0-922f-41b9d90007e1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.network.neutron [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-db2305c4-efc8-4e86-ac3d-6767615695a8 req-12ffa097-3503-417e-bf0d-df70ed918f40 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received event network-changed-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-db2305c4-efc8-4e86-ac3d-6767615695a8 req-12ffa097-3503-417e-bf0d-df70ed918f40 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Refreshing instance network info cache due to event network-changed-fa088ead-65e0-4379-9aa4-a6a4f7f727ac. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-db2305c4-efc8-4e86-ac3d-6767615695a8 req-12ffa097-3503-417e-bf0d-df70ed918f40 service nova] Acquiring lock "refresh_cache-fe94a683-8d67-48e0-922f-41b9d90007e1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:29:54 user nova-compute[74963]: DEBUG nova.network.neutron [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.network.neutron [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Updating instance_info_cache with network_info: [{"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Releasing lock "refresh_cache-fe94a683-8d67-48e0-922f-41b9d90007e1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Instance network_info: |[{"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-db2305c4-efc8-4e86-ac3d-6767615695a8 req-12ffa097-3503-417e-bf0d-df70ed918f40 service nova] Acquired lock "refresh_cache-fe94a683-8d67-48e0-922f-41b9d90007e1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.network.neutron [req-db2305c4-efc8-4e86-ac3d-6767615695a8 req-12ffa097-3503-417e-bf0d-df70ed918f40 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Refreshing network info cache for port fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Start _get_guest_xml network_info=[{"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:29:55 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:29:55 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1860053928',display_name='tempest-VolumesNegativeTest-instance-1860053928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1860053928',id=36,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b2cd47bda3841648212c2a6ffcb650b',ramdisk_id='',reservation_id='r-qtm0rxrx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2077678526',owner_user_name='tempest-VolumesNegativeTest-2077678526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:29:53Z,user_data=None,user_id='8e43ff694ce34909994e9bb3d04b0f0c',uuid=fe94a683-8d67-48e0-922f-41b9d90007e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Converting VIF {"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=fa088ead-65e0-4379-9aa4-a6a4f7f727ac,network=Network(4f7f4317-0408-4a47-8b7e-7ccd90e85fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa088ead-65') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.objects.instance [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lazy-loading 'pci_devices' on Instance uuid fe94a683-8d67-48e0-922f-41b9d90007e1 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:29:55 user nova-compute[74963]:   <uuid>fe94a683-8d67-48e0-922f-41b9d90007e1</uuid>
Nov 30 08:29:55 user nova-compute[74963]:   <name>instance-00000024</name>
Nov 30 08:29:55 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:29:55 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:29:55 user nova-compute[74963]:   <metadata>
Nov 30 08:29:55 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:29:55 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:29:55 user nova-compute[74963]:       <nova:name>tempest-VolumesNegativeTest-instance-1860053928</nova:name>
Nov 30 08:29:55 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:29:55</nova:creationTime>
Nov 30 08:29:55 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:29:55 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:29:55 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:29:55 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:29:55 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:29:55 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:29:55 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:29:55 user nova-compute[74963]:       <nova:owner>
Nov 30 08:29:55 user nova-compute[74963]:         <nova:user uuid="8e43ff694ce34909994e9bb3d04b0f0c">tempest-VolumesNegativeTest-2077678526-project-member</nova:user>
Nov 30 08:29:55 user nova-compute[74963]:         <nova:project uuid="8b2cd47bda3841648212c2a6ffcb650b">tempest-VolumesNegativeTest-2077678526</nova:project>
Nov 30 08:29:55 user nova-compute[74963]:       </nova:owner>
Nov 30 08:29:55 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:29:55 user nova-compute[74963]:       <nova:ports>
Nov 30 08:29:55 user nova-compute[74963]:         <nova:port uuid="fa088ead-65e0-4379-9aa4-a6a4f7f727ac">
Nov 30 08:29:55 user nova-compute[74963]:           <nova:ip type="fixed" address="192.168.233.161" ipVersion="4"/>
Nov 30 08:29:55 user nova-compute[74963]:         </nova:port>
Nov 30 08:29:55 user nova-compute[74963]:       </nova:ports>
Nov 30 08:29:55 user nova-compute[74963]:     </nova:instance>
Nov 30 08:29:55 user nova-compute[74963]:   </metadata>
Nov 30 08:29:55 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:29:55 user nova-compute[74963]:     <system>
Nov 30 08:29:55 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:29:55 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:29:55 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:29:55 user nova-compute[74963]:       <entry name="serial">fe94a683-8d67-48e0-922f-41b9d90007e1</entry>
Nov 30 08:29:55 user nova-compute[74963]:       <entry name="uuid">fe94a683-8d67-48e0-922f-41b9d90007e1</entry>
Nov 30 08:29:55 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:29:55 user nova-compute[74963]:     </system>
Nov 30 08:29:55 user nova-compute[74963]:   </sysinfo>
Nov 30 08:29:55 user nova-compute[74963]:   <os>
Nov 30 08:29:55 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:29:55 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:29:55 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:29:55 user nova-compute[74963]:   </os>
Nov 30 08:29:55 user nova-compute[74963]:   <features>
Nov 30 08:29:55 user nova-compute[74963]:     <acpi/>
Nov 30 08:29:55 user nova-compute[74963]:     <apic/>
Nov 30 08:29:55 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:29:55 user nova-compute[74963]:   </features>
Nov 30 08:29:55 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:29:55 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:29:55 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:29:55 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:29:55 user nova-compute[74963]:   </clock>
Nov 30 08:29:55 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:29:55 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:29:55 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:29:55 user nova-compute[74963]:   </cpu>
Nov 30 08:29:55 user nova-compute[74963]:   <devices>
Nov 30 08:29:55 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:29:55 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:29:55 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk"/>
Nov 30 08:29:55 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:29:55 user nova-compute[74963]:     </disk>
Nov 30 08:29:55 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:29:55 user nova-compute[74963]:       <mac address="fa:16:3e:66:12:ff"/>
Nov 30 08:29:55 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:29:55 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:29:55 user nova-compute[74963]:       <target dev="tapfa088ead-65"/>
Nov 30 08:29:55 user nova-compute[74963]:     </interface>
Nov 30 08:29:55 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:29:55 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/console.log" append="off"/>
Nov 30 08:29:55 user nova-compute[74963]:     </serial>
Nov 30 08:29:55 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:29:55 user nova-compute[74963]:     <video>
Nov 30 08:29:55 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:29:55 user nova-compute[74963]:     </video>
Nov 30 08:29:55 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:29:55 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:29:55 user nova-compute[74963]:     </rng>
Nov 30 08:29:55 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:29:55 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:29:55 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:29:55 user nova-compute[74963]:     </memballoon>
Nov 30 08:29:55 user nova-compute[74963]:   </devices>
Nov 30 08:29:55 user nova-compute[74963]: </domain>
Nov 30 08:29:55 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1860053928',display_name='tempest-VolumesNegativeTest-instance-1860053928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1860053928',id=36,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b2cd47bda3841648212c2a6ffcb650b',ramdisk_id='',reservation_id='r-qtm0rxrx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2077678526',owner_user_name='tempest-VolumesNegativeTest-2077678526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:29:53Z,user_data=None,user_id='8e43ff694ce34909994e9bb3d04b0f0c',uuid=fe94a683-8d67-48e0-922f-41b9d90007e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Converting VIF {"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=fa088ead-65e0-4379-9aa4-a6a4f7f727ac,network=Network(4f7f4317-0408-4a47-8b7e-7ccd90e85fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa088ead-65') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG os_vif [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=fa088ead-65e0-4379-9aa4-a6a4f7f727ac,network=Network(4f7f4317-0408-4a47-8b7e-7ccd90e85fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa088ead-65') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b30d99c-6365-5449-b207-2edc21f41704', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa088ead-65, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa088ead-65, col_values=(('qos', UUID('8b66a7c5-0eef-487d-a490-3ccc6a85b91a')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa088ead-65, col_values=(('external_ids', {'iface-id': 'fa088ead-65e0-4379-9aa4-a6a4f7f727ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:12:ff', 'vm-uuid': 'fe94a683-8d67-48e0-922f-41b9d90007e1'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:55 user nova-compute[74963]: INFO os_vif [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=fa088ead-65e0-4379-9aa4-a6a4f7f727ac,network=Network(4f7f4317-0408-4a47-8b7e-7ccd90e85fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa088ead-65')
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] No VIF found with MAC fa:16:3e:66:12:ff, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.network.neutron [req-db2305c4-efc8-4e86-ac3d-6767615695a8 req-12ffa097-3503-417e-bf0d-df70ed918f40 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Updated VIF entry in instance network info cache for port fa088ead-65e0-4379-9aa4-a6a4f7f727ac. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG nova.network.neutron [req-db2305c4-efc8-4e86-ac3d-6767615695a8 req-12ffa097-3503-417e-bf0d-df70ed918f40 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Updating instance_info_cache with network_info: [{"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:29:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-db2305c4-efc8-4e86-ac3d-6767615695a8 req-12ffa097-3503-417e-bf0d-df70ed918f40 service nova] Releasing lock "refresh_cache-fe94a683-8d67-48e0-922f-41b9d90007e1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:29:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-402cc96c-3d5e-4a61-ba34-9a30495c724c req-2390501e-3eea-49e6-9195-4a0d93636bba service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received event network-vif-plugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-402cc96c-3d5e-4a61-ba34-9a30495c724c req-2390501e-3eea-49e6-9195-4a0d93636bba service nova] Acquiring lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-402cc96c-3d5e-4a61-ba34-9a30495c724c req-2390501e-3eea-49e6-9195-4a0d93636bba service nova] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-402cc96c-3d5e-4a61-ba34-9a30495c724c req-2390501e-3eea-49e6-9195-4a0d93636bba service nova] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-402cc96c-3d5e-4a61-ba34-9a30495c724c req-2390501e-3eea-49e6-9195-4a0d93636bba service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] No waiting events found dispatching network-vif-plugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:57 user nova-compute[74963]: WARNING nova.compute.manager [req-402cc96c-3d5e-4a61-ba34-9a30495c724c req-2390501e-3eea-49e6-9195-4a0d93636bba service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received unexpected event network-vif-plugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac for instance with vm_state building and task_state spawning.
Nov 30 08:29:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:29:57 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc is timed out.
Nov 30 08:29:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully detached device vdc from instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc from the live domain config.
Nov 30 08:29:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrJXUimB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:29:57 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa86516-ddf3-47f9-b892-8a42432aa9ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:29:57 user nova-compute[74963]: No targets found.
Nov 30 08:29:57 user nova-compute[74963]: iSNS:
Nov 30 08:29:57 user nova-compute[74963]: No targets found.
Nov 30 08:29:57 user nova-compute[74963]: STATIC:
Nov 30 08:29:57 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a
Nov 30 08:29:57 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:29:57 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:29:57 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760
Nov 30 08:29:57 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:29:57 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:29:57 user nova-compute[74963]: FIRMWARE:
Nov 30 08:29:57 user nova-compute[74963]: No targets found.
Nov 30 08:29:57 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:29:57 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:29:57 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85d1d8f-fd0b-4b97-a6e7-302a6ab14709]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae468767-0e08-4cdc-82f6-895d18e7e610]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:57 user nova-compute[74963]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)
Nov 30 08:29:57 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:29:57 user nova-compute[74963]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 (non-flash)
Nov 30 08:29:57 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6220756dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760'): ({'sdd'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Removing single pathed devices sdd {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aa92c1-f9e8-4abf-8096-c3cf499b9208]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56b4b8c-7d29-4ae6-a2bb-7dc31c631685]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Flushing IO for device /dev/sdd {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:29:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f77e97-7070-476b-bdb7-78fa1809e6be]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe1daf4-b5eb-4ef5-8e0c-907467aab3c1]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[86828b1f-f1f6-487c-ae98-9ced10ae4f03]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7ecd79-8625-4cd9-937a-4c257c3e0bac]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760, portal: 172.16.0.220,3260]
Nov 30 08:29:58 user nova-compute[74963]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760, portal: 172.16.0.220,3260] successful.
Nov 30 08:29:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30429d68-e1e0-42c3-84ec-4a2d4d1b3760 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d2f0de-8418-4dda-b298-f7e1fd6cdd38]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] <== disconnect_volume: return (314ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:29:58 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'flavor' on Instance uuid 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ef8cb450-2a43-4aba-81ed-ce8a6d580616 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:59 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Instance spawned successfully.
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-e0e72089-727a-4efa-a05a-c0bd9f4cb062 req-cec0bb0d-08a6-402f-8419-8f9fcab4cc9d service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received event network-vif-plugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e0e72089-727a-4efa-a05a-c0bd9f4cb062 req-cec0bb0d-08a6-402f-8419-8f9fcab4cc9d service nova] Acquiring lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e0e72089-727a-4efa-a05a-c0bd9f4cb062 req-cec0bb0d-08a6-402f-8419-8f9fcab4cc9d service nova] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e0e72089-727a-4efa-a05a-c0bd9f4cb062 req-cec0bb0d-08a6-402f-8419-8f9fcab4cc9d service nova] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-e0e72089-727a-4efa-a05a-c0bd9f4cb062 req-cec0bb0d-08a6-402f-8419-8f9fcab4cc9d service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] No waiting events found dispatching network-vif-plugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:29:59 user nova-compute[74963]: WARNING nova.compute.manager [req-e0e72089-727a-4efa-a05a-c0bd9f4cb062 req-cec0bb0d-08a6-402f-8419-8f9fcab4cc9d service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received unexpected event network-vif-plugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac for instance with vm_state building and task_state spawning.
Nov 30 08:29:59 user nova-compute[74963]: INFO nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 30 08:29:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:29:59 user nova-compute[74963]: INFO nova.compute.manager [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Took 6.56 seconds to build instance.
Nov 30 08:29:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-34520572-b886-4caa-b8bb-c034f8f8cd86 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.655s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:29:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:00 user nova-compute[74963]: INFO nova.compute.manager [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Terminating instance
Nov 30 08:30:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Instance destroyed successfully.
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.objects.instance [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lazy-loading 'resources' on Instance uuid 09eb9cb2-da5e-4152-a0b8-925f08d221fc {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1897655427',display_name='tempest-AttachVolumeTestJSON-server-1897655427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1897655427',id=32,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5DkGfom1SzP4SKJ9596qlL39pOJrHnwYhLgyqis4l+MUCgjvv56rJWVCJKGbhOYRpSo6uUzlTNbdXjW3ZocJdxYBFLLlVMsWrYr9YAdQbSIsAqeqD/eUUxBxpdWQ6CgQ==',key_name='tempest-keypair-702226631',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8be2ffbe2e411590d35d9c12196ba8',ramdisk_id='',reservation_id='r-42s3msun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1519701713',owner_user_name='tempest-AttachVolumeTestJSON-1519701713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:27:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faaefd1e3d946eba7123229378d79fe',uuid=09eb9cb2-da5e-4152-a0b8-925f08d221fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converting VIF {"id": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "address": "fa:16:3e:7a:8a:b3", "network": {"id": "910f653d-3433-4413-96f9-1f4b9aaf7e0a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-842195752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8be2ffbe2e411590d35d9c12196ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb5b7f0-26", "ovs_interfaceid": "aeb5b7f0-26d2-4990-8d96-f1d699444676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeb5b7f0-26d2-4990-8d96-f1d699444676,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb5b7f0-26') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG os_vif [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeb5b7f0-26d2-4990-8d96-f1d699444676,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb5b7f0-26') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeb5b7f0-26, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18d666a4-2634-48f1-b314-7601a44fa325) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:30:01 user nova-compute[74963]: INFO os_vif [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeb5b7f0-26d2-4990-8d96-f1d699444676,network=Network(910f653d-3433-4413-96f9-1f4b9aaf7e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb5b7f0-26')
Nov 30 08:30:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Deleting instance files /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc_del
Nov 30 08:30:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Deletion of /opt/stack/data/nova/instances/09eb9cb2-da5e-4152-a0b8-925f08d221fc_del complete
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received event network-vif-unplugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] No waiting events found dispatching network-vif-unplugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received event network-vif-unplugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received event network-vif-plugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] Acquiring lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.compute.manager [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] No waiting events found dispatching network-vif-plugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:30:01 user nova-compute[74963]: WARNING nova.compute.manager [req-adc277a6-cad2-4dc5-9960-f36fa6903175 req-5391cf44-4a6c-401c-a8cb-4e251850578b service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received unexpected event network-vif-plugged-aeb5b7f0-26d2-4990-8d96-f1d699444676 for instance with vm_state active and task_state deleting.
Nov 30 08:30:01 user nova-compute[74963]: INFO nova.compute.manager [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 30 08:30:01 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:30:01 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:30:02 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:30:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-1199df88-d42f-4416-9967-40044211a523 req-d72d95b5-9164-4a09-8b9a-56d38f7d0ba4 service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Received event network-vif-deleted-aeb5b7f0-26d2-4990-8d96-f1d699444676 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:02 user nova-compute[74963]: INFO nova.compute.manager [req-1199df88-d42f-4416-9967-40044211a523 req-d72d95b5-9164-4a09-8b9a-56d38f7d0ba4 service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Neutron deleted interface aeb5b7f0-26d2-4990-8d96-f1d699444676; detaching it from the instance and deleting it from the info cache
Nov 30 08:30:02 user nova-compute[74963]: DEBUG nova.network.neutron [req-1199df88-d42f-4416-9967-40044211a523 req-d72d95b5-9164-4a09-8b9a-56d38f7d0ba4 service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:30:02 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Took 0.83 seconds to deallocate network for instance.
Nov 30 08:30:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-1199df88-d42f-4416-9967-40044211a523 req-d72d95b5-9164-4a09-8b9a-56d38f7d0ba4 service nova] [instance: 09eb9cb2-da5e-4152-a0b8-925f08d221fc] Detach interface failed, port_id=aeb5b7f0-26d2-4990-8d96-f1d699444676, reason: Instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:30:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:02 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:30:02 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:30:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:02 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Deleted allocations for instance 09eb9cb2-da5e-4152-a0b8-925f08d221fc
Nov 30 08:30:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-94bc1e21-0bb0-4851-a3f2-22194fec7b53 tempest-AttachVolumeTestJSON-1519701713 tempest-AttachVolumeTestJSON-1519701713-project-member] Lock "09eb9cb2-da5e-4152-a0b8-925f08d221fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.185s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "9feae61e-e897-4fa0-b534-157153e8f6c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:14 user nova-compute[74963]: INFO nova.compute.manager [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Terminating instance
Nov 30 08:30:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:30:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-afeac461-69ef-462f-a24e-7b0ddf703b7c req-1fbb4f45-74c0-4591-8ddf-9aa08c3d0541 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received event network-vif-unplugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-afeac461-69ef-462f-a24e-7b0ddf703b7c req-1fbb4f45-74c0-4591-8ddf-9aa08c3d0541 service nova] Acquiring lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-afeac461-69ef-462f-a24e-7b0ddf703b7c req-1fbb4f45-74c0-4591-8ddf-9aa08c3d0541 service nova] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-afeac461-69ef-462f-a24e-7b0ddf703b7c req-1fbb4f45-74c0-4591-8ddf-9aa08c3d0541 service nova] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-afeac461-69ef-462f-a24e-7b0ddf703b7c req-1fbb4f45-74c0-4591-8ddf-9aa08c3d0541 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] No waiting events found dispatching network-vif-unplugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.compute.manager [req-afeac461-69ef-462f-a24e-7b0ddf703b7c req-1fbb4f45-74c0-4591-8ddf-9aa08c3d0541 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received event network-vif-unplugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Instance destroyed successfully.
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.objects.instance [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lazy-loading 'resources' on Instance uuid 9feae61e-e897-4fa0-b534-157153e8f6c3 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2113163309',display_name='tempest-ServerActionsTestOtherA-server-2113163309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2113163309',id=17,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsWMnq1ufqR++qStn5b43QWm222qTuytohSz8l1/sudpdFVTZkwiTwMp7sHBCXTNfQV4IhtlWVxhMZmDIqgf0oPJwcUspQxqKKVyuXcOkB5qHVJX6ziQnRILaSQcb0Pg==',key_name='tempest-keypair-537501141',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:11:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e22db86fd7a54c5c9882623605de5608',ramdisk_id='',reservation_id='r-04bdi8vo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768867057',owner_user_name='tempest-ServerActionsTestOtherA-768867057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c803479aa87e4be79682975d47b7ccfd',uuid=9feae61e-e897-4fa0-b534-157153e8f6c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converting VIF {"id": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "address": "fa:16:3e:eb:fb:bc", "network": {"id": "98031d03-2c27-4a09-b0d3-11f0c04b585e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1264134844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22db86fd7a54c5c9882623605de5608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdcb2ee3-67", "ovs_interfaceid": "bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:fb:bc,bridge_name='br-int',has_traffic_filtering=True,id=bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdcb2ee3-67') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG os_vif [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:fb:bc,bridge_name='br-int',has_traffic_filtering=True,id=bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdcb2ee3-67') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdcb2ee3-67, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68259b3d-f54c-48a5-9c4e-eee1eaa261c7) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:30:15 user nova-compute[74963]: INFO os_vif [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:fb:bc,bridge_name='br-int',has_traffic_filtering=True,id=bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b,network=Network(98031d03-2c27-4a09-b0d3-11f0c04b585e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdcb2ee3-67')
Nov 30 08:30:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Deleting instance files /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3_del
Nov 30 08:30:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Deletion of /opt/stack/data/nova/instances/9feae61e-e897-4fa0-b534-157153e8f6c3_del complete
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:15 user nova-compute[74963]: INFO nova.compute.manager [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 30 08:30:15 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:30:15 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:30:16 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:30:16 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8252MB free_disk=25.24844741821289GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:30:16 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Took 0.74 seconds to deallocate network for instance.
Nov 30 08:30:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 9feae61e-e897-4fa0-b534-157153e8f6c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 99ad690e-258d-43d1-a217-8b49cf501fa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 0a2e6446-42c0-4c91-a31c-6d645ccc9db2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 8edb9852-d3f7-491a-a9e3-77d9c0f84588 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance fe94a683-8d67-48e0-922f-41b9d90007e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.248s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:17 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:30:17 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:30:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:17 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Deleted allocations for instance 9feae61e-e897-4fa0-b534-157153e8f6c3
Nov 30 08:30:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-40004a53-27e7-4147-b642-ecfcf5a27824 tempest-ServerActionsTestOtherA-768867057 tempest-ServerActionsTestOtherA-768867057-project-member] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-b6374dc5-b812-4c79-9588-ef43a8c0537d req-11e8d8d1-d556-4f1e-92af-e30bde110005 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received event network-vif-plugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b6374dc5-b812-4c79-9588-ef43a8c0537d req-11e8d8d1-d556-4f1e-92af-e30bde110005 service nova] Acquiring lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b6374dc5-b812-4c79-9588-ef43a8c0537d req-11e8d8d1-d556-4f1e-92af-e30bde110005 service nova] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-b6374dc5-b812-4c79-9588-ef43a8c0537d req-11e8d8d1-d556-4f1e-92af-e30bde110005 service nova] Lock "9feae61e-e897-4fa0-b534-157153e8f6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-b6374dc5-b812-4c79-9588-ef43a8c0537d req-11e8d8d1-d556-4f1e-92af-e30bde110005 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] No waiting events found dispatching network-vif-plugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:30:17 user nova-compute[74963]: WARNING nova.compute.manager [req-b6374dc5-b812-4c79-9588-ef43a8c0537d req-11e8d8d1-d556-4f1e-92af-e30bde110005 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received unexpected event network-vif-plugged-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b for instance with vm_state deleted and task_state None.
Nov 30 08:30:17 user nova-compute[74963]: DEBUG nova.compute.manager [req-b6374dc5-b812-4c79-9588-ef43a8c0537d req-11e8d8d1-d556-4f1e-92af-e30bde110005 service nova] [instance: 9feae61e-e897-4fa0-b534-157153e8f6c3] Received event network-vif-deleted-bdcb2ee3-6780-4ebf-a1e9-43d3be5ba24b {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:18 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:18 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:30:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:30:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:30:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:30:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updating instance_info_cache with network_info: [{"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:30:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:30:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:30:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:30:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:21 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:30:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:30:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:30:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:30:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:30:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:30:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-0e5067f7-ac11-4fea-bef7-d051885f79bc req-26b52c66-9aa4-4bff-92f4-61578733fe65 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received event network-changed-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-0e5067f7-ac11-4fea-bef7-d051885f79bc req-26b52c66-9aa4-4bff-92f4-61578733fe65 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Refreshing instance network info cache due to event network-changed-40cfb7c1-9e69-4651-81c2-a0b380f8e758. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:30:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0e5067f7-ac11-4fea-bef7-d051885f79bc req-26b52c66-9aa4-4bff-92f4-61578733fe65 service nova] Acquiring lock "refresh_cache-0a2e6446-42c0-4c91-a31c-6d645ccc9db2" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:30:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0e5067f7-ac11-4fea-bef7-d051885f79bc req-26b52c66-9aa4-4bff-92f4-61578733fe65 service nova] Acquired lock "refresh_cache-0a2e6446-42c0-4c91-a31c-6d645ccc9db2" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:30:51 user nova-compute[74963]: DEBUG nova.network.neutron [req-0e5067f7-ac11-4fea-bef7-d051885f79bc req-26b52c66-9aa4-4bff-92f4-61578733fe65 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Refreshing network info cache for port 40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:52 user nova-compute[74963]: INFO nova.compute.manager [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Terminating instance
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.network.neutron [req-0e5067f7-ac11-4fea-bef7-d051885f79bc req-26b52c66-9aa4-4bff-92f4-61578733fe65 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Updated VIF entry in instance network info cache for port 40cfb7c1-9e69-4651-81c2-a0b380f8e758. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.network.neutron [req-0e5067f7-ac11-4fea-bef7-d051885f79bc req-26b52c66-9aa4-4bff-92f4-61578733fe65 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Updating instance_info_cache with network_info: [{"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-0e5067f7-ac11-4fea-bef7-d051885f79bc req-26b52c66-9aa4-4bff-92f4-61578733fe65 service nova] Releasing lock "refresh_cache-0a2e6446-42c0-4c91-a31c-6d645ccc9db2" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-7af76149-fa34-41b1-858f-5274bacd6546 req-dec20338-8b64-45fb-a1bc-4472b7e3e57e service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received event network-vif-unplugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7af76149-fa34-41b1-858f-5274bacd6546 req-dec20338-8b64-45fb-a1bc-4472b7e3e57e service nova] Acquiring lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7af76149-fa34-41b1-858f-5274bacd6546 req-dec20338-8b64-45fb-a1bc-4472b7e3e57e service nova] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7af76149-fa34-41b1-858f-5274bacd6546 req-dec20338-8b64-45fb-a1bc-4472b7e3e57e service nova] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-7af76149-fa34-41b1-858f-5274bacd6546 req-dec20338-8b64-45fb-a1bc-4472b7e3e57e service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] No waiting events found dispatching network-vif-unplugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-7af76149-fa34-41b1-858f-5274bacd6546 req-dec20338-8b64-45fb-a1bc-4472b7e3e57e service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received event network-vif-unplugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:52 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Instance destroyed successfully.
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.objects.instance [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'resources' on Instance uuid 0a2e6446-42c0-4c91-a31c-6d645ccc9db2 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-512583283',display_name='tempest-AttachVolumeNegativeTest-server-512583283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-512583283',id=34,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6obuUXAjVWEltXiO7Htfp+jJcptIQ6wRWmbChIR4apMGsX4r6gLKdOYzJ43nzFJBk1B3pYUHKkFAp5bsjMLULGrtHsnzE8FT7GIvZ7n6aBYTVk0nOnCp/KARCI5Hidmw==',key_name='tempest-keypair-1450796213',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-abun1m7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:29:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=0a2e6446-42c0-4c91-a31c-6d645ccc9db2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "address": "fa:16:3e:11:d1:d2", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfb7c1-9e", "ovs_interfaceid": "40cfb7c1-9e69-4651-81c2-a0b380f8e758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:d1:d2,bridge_name='br-int',has_traffic_filtering=True,id=40cfb7c1-9e69-4651-81c2-a0b380f8e758,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfb7c1-9e') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG os_vif [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:d1:d2,bridge_name='br-int',has_traffic_filtering=True,id=40cfb7c1-9e69-4651-81c2-a0b380f8e758,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfb7c1-9e') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40cfb7c1-9e, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4caff3ae-168b-4964-8473-a2d36818ce2b) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:52 user nova-compute[74963]: INFO os_vif [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:d1:d2,bridge_name='br-int',has_traffic_filtering=True,id=40cfb7c1-9e69-4651-81c2-a0b380f8e758,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfb7c1-9e')
Nov 30 08:30:52 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Deleting instance files /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2_del
Nov 30 08:30:52 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Deletion of /opt/stack/data/nova/instances/0a2e6446-42c0-4c91-a31c-6d645ccc9db2_del complete
Nov 30 08:30:52 user nova-compute[74963]: INFO nova.compute.manager [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 30 08:30:52 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:30:52 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:30:53 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:30:53 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Took 0.68 seconds to deallocate network for instance.
Nov 30 08:30:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:53 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:30:53 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:30:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:53 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Deleted allocations for instance 0a2e6446-42c0-4c91-a31c-6d645ccc9db2
Nov 30 08:30:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1c270c04-9563-420f-af44-a3bcbf5ebaf9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.736s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-1d5ac6b9-093e-4e82-86b8-8874cb95c154 req-66ab89c3-0e79-4894-b1a4-3e77954a61d9 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received event network-vif-plugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1d5ac6b9-093e-4e82-86b8-8874cb95c154 req-66ab89c3-0e79-4894-b1a4-3e77954a61d9 service nova] Acquiring lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:30:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1d5ac6b9-093e-4e82-86b8-8874cb95c154 req-66ab89c3-0e79-4894-b1a4-3e77954a61d9 service nova] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:30:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1d5ac6b9-093e-4e82-86b8-8874cb95c154 req-66ab89c3-0e79-4894-b1a4-3e77954a61d9 service nova] Lock "0a2e6446-42c0-4c91-a31c-6d645ccc9db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:30:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-1d5ac6b9-093e-4e82-86b8-8874cb95c154 req-66ab89c3-0e79-4894-b1a4-3e77954a61d9 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] No waiting events found dispatching network-vif-plugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:30:54 user nova-compute[74963]: WARNING nova.compute.manager [req-1d5ac6b9-093e-4e82-86b8-8874cb95c154 req-66ab89c3-0e79-4894-b1a4-3e77954a61d9 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received unexpected event network-vif-plugged-40cfb7c1-9e69-4651-81c2-a0b380f8e758 for instance with vm_state deleted and task_state None.
Nov 30 08:30:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-1d5ac6b9-093e-4e82-86b8-8874cb95c154 req-66ab89c3-0e79-4894-b1a4-3e77954a61d9 service nova] [instance: 0a2e6446-42c0-4c91-a31c-6d645ccc9db2] Received event network-vif-deleted-40cfb7c1-9e69-4651-81c2-a0b380f8e758 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:30:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:30:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:31:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:07 user nova-compute[74963]: INFO nova.compute.manager [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Terminating instance
Nov 30 08:31:07 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-3250e96b-57d1-464b-8a0f-a25a8fba36d9 req-70c6cae0-8188-4f77-95f9-7642c8601781 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received event network-vif-unplugged-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3250e96b-57d1-464b-8a0f-a25a8fba36d9 req-70c6cae0-8188-4f77-95f9-7642c8601781 service nova] Acquiring lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3250e96b-57d1-464b-8a0f-a25a8fba36d9 req-70c6cae0-8188-4f77-95f9-7642c8601781 service nova] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3250e96b-57d1-464b-8a0f-a25a8fba36d9 req-70c6cae0-8188-4f77-95f9-7642c8601781 service nova] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-3250e96b-57d1-464b-8a0f-a25a8fba36d9 req-70c6cae0-8188-4f77-95f9-7642c8601781 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] No waiting events found dispatching network-vif-unplugged-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG nova.compute.manager [req-3250e96b-57d1-464b-8a0f-a25a8fba36d9 req-70c6cae0-8188-4f77-95f9-7642c8601781 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received event network-vif-unplugged-66f7751d-a800-4f1c-b7b3-9105546efdbf for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:31:08 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Instance destroyed successfully.
Nov 30 08:31:08 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lazy-loading 'resources' on Instance uuid 8edb9852-d3f7-491a-a9e3-77d9c0f84588 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-682064681',display_name='tempest-VolumesActionsTest-instance-682064681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-682064681',id=35,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:29:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='621629205e28463da81ed0f7a32c34a3',ramdisk_id='',reservation_id='r-9dp2a9jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-854532865',owner_user_name='tempest-VolumesActionsTest-854532865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:29:24Z,user_data=None,user_id='aa0ff65bec754a9c931f9faa50e53077',uuid=8edb9852-d3f7-491a-a9e3-77d9c0f84588,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converting VIF {"id": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "address": "fa:16:3e:5d:3c:b5", "network": {"id": "9d78bfb2-59b5-4622-a753-96baa9d9c6cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1062876660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621629205e28463da81ed0f7a32c34a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f7751d-a8", "ovs_interfaceid": "66f7751d-a800-4f1c-b7b3-9105546efdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=66f7751d-a800-4f1c-b7b3-9105546efdbf,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f7751d-a8') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG os_vif [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=66f7751d-a800-4f1c-b7b3-9105546efdbf,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f7751d-a8') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66f7751d-a8, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7647faa3-6703-4646-b7e2-6bd73f82f9b2) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:31:08 user nova-compute[74963]: INFO os_vif [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=66f7751d-a800-4f1c-b7b3-9105546efdbf,network=Network(9d78bfb2-59b5-4622-a753-96baa9d9c6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f7751d-a8')
Nov 30 08:31:08 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Deleting instance files /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588_del
Nov 30 08:31:08 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Deletion of /opt/stack/data/nova/instances/8edb9852-d3f7-491a-a9e3-77d9c0f84588_del complete
Nov 30 08:31:08 user nova-compute[74963]: INFO nova.compute.manager [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 30 08:31:08 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:31:08 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:31:09 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:31:09 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Took 0.50 seconds to deallocate network for instance.
Nov 30 08:31:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:09 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:31:09 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:31:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:09 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Deleted allocations for instance 8edb9852-d3f7-491a-a9e3-77d9c0f84588
Nov 30 08:31:09 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ae4ee095-b5f1-407a-bfb2-053cf786d6b6 tempest-VolumesActionsTest-854532865 tempest-VolumesActionsTest-854532865-project-member] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.712s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-4698aedb-8610-490d-bbaf-09b8ca4df6f5 req-14ade982-1ad5-4701-8077-36c77c72edf2 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received event network-vif-plugged-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:31:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4698aedb-8610-490d-bbaf-09b8ca4df6f5 req-14ade982-1ad5-4701-8077-36c77c72edf2 service nova] Acquiring lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4698aedb-8610-490d-bbaf-09b8ca4df6f5 req-14ade982-1ad5-4701-8077-36c77c72edf2 service nova] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4698aedb-8610-490d-bbaf-09b8ca4df6f5 req-14ade982-1ad5-4701-8077-36c77c72edf2 service nova] Lock "8edb9852-d3f7-491a-a9e3-77d9c0f84588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-4698aedb-8610-490d-bbaf-09b8ca4df6f5 req-14ade982-1ad5-4701-8077-36c77c72edf2 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] No waiting events found dispatching network-vif-plugged-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:31:10 user nova-compute[74963]: WARNING nova.compute.manager [req-4698aedb-8610-490d-bbaf-09b8ca4df6f5 req-14ade982-1ad5-4701-8077-36c77c72edf2 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received unexpected event network-vif-plugged-66f7751d-a800-4f1c-b7b3-9105546efdbf for instance with vm_state deleted and task_state None.
Nov 30 08:31:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-4698aedb-8610-490d-bbaf-09b8ca4df6f5 req-14ade982-1ad5-4701-8077-36c77c72edf2 service nova] [instance: 8edb9852-d3f7-491a-a9e3-77d9c0f84588] Received event network-vif-deleted-66f7751d-a800-4f1c-b7b3-9105546efdbf {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:31:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:15 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:31:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:31:17 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:31:17 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:31:17 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=25.319061279296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 99ad690e-258d-43d1-a217-8b49cf501fa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance fe94a683-8d67-48e0-922f-41b9d90007e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:31:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:31:19 user nova-compute[74963]: INFO nova.compute.claims [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Claim successful on node user
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:31:19 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Didn't find any instances for network info cache update. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:31:19 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Creating image(s)
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG nova.policy [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad49a6fbce944b719e6f09a5e2bd1b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c9009714354721a7697c14258ffc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk 1073741824" returned: 0 in 0.058s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Cannot resize image /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Ensure instance console log exists: /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:20 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Successfully created port: c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Successfully updated port: c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquired lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-72eb5d43-6efa-4c1e-9506-ba1458daf756 req-28955f79-2177-4947-a49c-f3ac700a4368 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-changed-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-72eb5d43-6efa-4c1e-9506-ba1458daf756 req-28955f79-2177-4947-a49c-f3ac700a4368 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Refreshing instance network info cache due to event network-changed-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-72eb5d43-6efa-4c1e-9506-ba1458daf756 req-28955f79-2177-4947-a49c-f3ac700a4368 service nova] Acquiring lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.network.neutron [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updating instance_info_cache with network_info: [{"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Releasing lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance network_info: |[{"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-72eb5d43-6efa-4c1e-9506-ba1458daf756 req-28955f79-2177-4947-a49c-f3ac700a4368 service nova] Acquired lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.network.neutron [req-72eb5d43-6efa-4c1e-9506-ba1458daf756 req-28955f79-2177-4947-a49c-f3ac700a4368 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Refreshing network info cache for port c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Start _get_guest_xml network_info=[{"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:31:21 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:31:21 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1988636161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1988636161',id=37,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPd4ASO80Kxi3NHD7OzgG3rXjragYl5NaXFAooh4ILUBXsjowt7I1YJBq0LOLUQMt8ITVotCYy3URmr4FfibwpVsXxiCTTUY3cIEhaGOBJ0iKmY0rHDe3iKGQAj7fVjtg==',key_name='tempest-keypair-1641280519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36c9009714354721a7697c14258ffc7d',ramdisk_id='',reservation_id='r-lytpxy1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1943160204',owner_user_name='tempest-AttachVolumeShelveTestJSON-1943160204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:31:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad49a6fbce944b719e6f09a5e2bd1b30',uuid=d5e59ea5-e429-426c-b89e-17aa7115ce84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converting VIF {"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.objects.instance [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'pci_devices' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:31:21 user nova-compute[74963]:   <uuid>d5e59ea5-e429-426c-b89e-17aa7115ce84</uuid>
Nov 30 08:31:21 user nova-compute[74963]:   <name>instance-00000025</name>
Nov 30 08:31:21 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:31:21 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:31:21 user nova-compute[74963]:   <metadata>
Nov 30 08:31:21 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:31:21 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:31:21 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1988636161</nova:name>
Nov 30 08:31:21 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:31:21</nova:creationTime>
Nov 30 08:31:21 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:31:21 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:31:21 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:31:21 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:31:21 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:31:21 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:31:21 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:31:21 user nova-compute[74963]:       <nova:owner>
Nov 30 08:31:21 user nova-compute[74963]:         <nova:user uuid="ad49a6fbce944b719e6f09a5e2bd1b30">tempest-AttachVolumeShelveTestJSON-1943160204-project-member</nova:user>
Nov 30 08:31:21 user nova-compute[74963]:         <nova:project uuid="36c9009714354721a7697c14258ffc7d">tempest-AttachVolumeShelveTestJSON-1943160204</nova:project>
Nov 30 08:31:21 user nova-compute[74963]:       </nova:owner>
Nov 30 08:31:21 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:31:21 user nova-compute[74963]:       <nova:ports>
Nov 30 08:31:21 user nova-compute[74963]:         <nova:port uuid="c36b3ac9-f1fb-4f70-8954-cc14592bf6c2">
Nov 30 08:31:21 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 08:31:21 user nova-compute[74963]:         </nova:port>
Nov 30 08:31:21 user nova-compute[74963]:       </nova:ports>
Nov 30 08:31:21 user nova-compute[74963]:     </nova:instance>
Nov 30 08:31:21 user nova-compute[74963]:   </metadata>
Nov 30 08:31:21 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:31:21 user nova-compute[74963]:     <system>
Nov 30 08:31:21 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:31:21 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:31:21 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:31:21 user nova-compute[74963]:       <entry name="serial">d5e59ea5-e429-426c-b89e-17aa7115ce84</entry>
Nov 30 08:31:21 user nova-compute[74963]:       <entry name="uuid">d5e59ea5-e429-426c-b89e-17aa7115ce84</entry>
Nov 30 08:31:21 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:31:21 user nova-compute[74963]:     </system>
Nov 30 08:31:21 user nova-compute[74963]:   </sysinfo>
Nov 30 08:31:21 user nova-compute[74963]:   <os>
Nov 30 08:31:21 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:31:21 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:31:21 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:31:21 user nova-compute[74963]:   </os>
Nov 30 08:31:21 user nova-compute[74963]:   <features>
Nov 30 08:31:21 user nova-compute[74963]:     <acpi/>
Nov 30 08:31:21 user nova-compute[74963]:     <apic/>
Nov 30 08:31:21 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:31:21 user nova-compute[74963]:   </features>
Nov 30 08:31:21 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:31:21 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:31:21 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:31:21 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:31:21 user nova-compute[74963]:   </clock>
Nov 30 08:31:21 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:31:21 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:31:21 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:31:21 user nova-compute[74963]:   </cpu>
Nov 30 08:31:21 user nova-compute[74963]:   <devices>
Nov 30 08:31:21 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:31:21 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:31:21 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk"/>
Nov 30 08:31:21 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:31:21 user nova-compute[74963]:     </disk>
Nov 30 08:31:21 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:31:21 user nova-compute[74963]:       <mac address="fa:16:3e:07:c6:af"/>
Nov 30 08:31:21 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:31:21 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:31:21 user nova-compute[74963]:       <target dev="tapc36b3ac9-f1"/>
Nov 30 08:31:21 user nova-compute[74963]:     </interface>
Nov 30 08:31:21 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:31:21 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/console.log" append="off"/>
Nov 30 08:31:21 user nova-compute[74963]:     </serial>
Nov 30 08:31:21 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:31:21 user nova-compute[74963]:     <video>
Nov 30 08:31:21 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:31:21 user nova-compute[74963]:     </video>
Nov 30 08:31:21 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:31:21 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:31:21 user nova-compute[74963]:     </rng>
Nov 30 08:31:21 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:31:21 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:31:21 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:31:21 user nova-compute[74963]:     </memballoon>
Nov 30 08:31:21 user nova-compute[74963]:   </devices>
Nov 30 08:31:21 user nova-compute[74963]: </domain>
Nov 30 08:31:21 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1988636161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1988636161',id=37,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPd4ASO80Kxi3NHD7OzgG3rXjragYl5NaXFAooh4ILUBXsjowt7I1YJBq0LOLUQMt8ITVotCYy3URmr4FfibwpVsXxiCTTUY3cIEhaGOBJ0iKmY0rHDe3iKGQAj7fVjtg==',key_name='tempest-keypair-1641280519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36c9009714354721a7697c14258ffc7d',ramdisk_id='',reservation_id='r-lytpxy1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1943160204',owner_user_name='tempest-AttachVolumeShelveTestJSON-1943160204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:31:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad49a6fbce944b719e6f09a5e2bd1b30',uuid=d5e59ea5-e429-426c-b89e-17aa7115ce84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converting VIF {"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG os_vif [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '219c836c-b1a2-5c1c-ba4a-1e5702b03d7d', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc36b3ac9-f1, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc36b3ac9-f1, col_values=(('qos', UUID('ec673194-a130-4841-9ab0-2f2618513f2d')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc36b3ac9-f1, col_values=(('external_ids', {'iface-id': 'c36b3ac9-f1fb-4f70-8954-cc14592bf6c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:c6:af', 'vm-uuid': 'd5e59ea5-e429-426c-b89e-17aa7115ce84'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:21 user nova-compute[74963]: INFO os_vif [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1')
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:31:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] No VIF found with MAC fa:16:3e:07:c6:af, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:31:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-72eb5d43-6efa-4c1e-9506-ba1458daf756 req-28955f79-2177-4947-a49c-f3ac700a4368 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updated VIF entry in instance network info cache for port c36b3ac9-f1fb-4f70-8954-cc14592bf6c2. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:31:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-72eb5d43-6efa-4c1e-9506-ba1458daf756 req-28955f79-2177-4947-a49c-f3ac700a4368 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updating instance_info_cache with network_info: [{"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:31:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-72eb5d43-6efa-4c1e-9506-ba1458daf756 req-28955f79-2177-4947-a49c-f3ac700a4368 service nova] Releasing lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:31:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-6669e8cc-ffe6-45b2-9f09-27a53d956a3f req-f4b54ce0-aabf-41a5-a4bd-8e411e4731fb service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6669e8cc-ffe6-45b2-9f09-27a53d956a3f req-f4b54ce0-aabf-41a5-a4bd-8e411e4731fb service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6669e8cc-ffe6-45b2-9f09-27a53d956a3f req-f4b54ce0-aabf-41a5-a4bd-8e411e4731fb service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6669e8cc-ffe6-45b2-9f09-27a53d956a3f req-f4b54ce0-aabf-41a5-a4bd-8e411e4731fb service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-6669e8cc-ffe6-45b2-9f09-27a53d956a3f req-f4b54ce0-aabf-41a5-a4bd-8e411e4731fb service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:31:23 user nova-compute[74963]: WARNING nova.compute.manager [req-6669e8cc-ffe6-45b2-9f09-27a53d956a3f req-f4b54ce0-aabf-41a5-a4bd-8e411e4731fb service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state building and task_state spawning.
Nov 30 08:31:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-c63b7b4b-2bec-4005-880d-9ce3c0be643c req-12a95429-14e7-4bd8-804d-de88edd16b8f service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c63b7b4b-2bec-4005-880d-9ce3c0be643c req-12a95429-14e7-4bd8-804d-de88edd16b8f service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c63b7b4b-2bec-4005-880d-9ce3c0be643c req-12a95429-14e7-4bd8-804d-de88edd16b8f service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c63b7b4b-2bec-4005-880d-9ce3c0be643c req-12a95429-14e7-4bd8-804d-de88edd16b8f service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-c63b7b4b-2bec-4005-880d-9ce3c0be643c req-12a95429-14e7-4bd8-804d-de88edd16b8f service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:31:25 user nova-compute[74963]: WARNING nova.compute.manager [req-c63b7b4b-2bec-4005-880d-9ce3c0be643c req-12a95429-14e7-4bd8-804d-de88edd16b8f service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state building and task_state spawning.
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:31:25 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance spawned successfully.
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:31:25 user nova-compute[74963]: INFO nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 30 08:31:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:31:25 user nova-compute[74963]: INFO nova.compute.manager [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Took 6.60 seconds to build instance.
Nov 30 08:31:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-1cbdf520-72cd-4c4b-9327-0e812c41aa6e tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.695s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:31:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:31:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:31:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:31:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquiring lock "fe94a683-8d67-48e0-922f-41b9d90007e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquiring lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:42 user nova-compute[74963]: INFO nova.compute.manager [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Terminating instance
Nov 30 08:31:42 user nova-compute[74963]: DEBUG nova.compute.manager [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:31:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-dc548c7f-81f0-4fbc-84ca-884e3b92e45f req-2bae0206-faf6-47b5-b7c8-4460b6a0b737 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received event network-vif-unplugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc548c7f-81f0-4fbc-84ca-884e3b92e45f req-2bae0206-faf6-47b5-b7c8-4460b6a0b737 service nova] Acquiring lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc548c7f-81f0-4fbc-84ca-884e3b92e45f req-2bae0206-faf6-47b5-b7c8-4460b6a0b737 service nova] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc548c7f-81f0-4fbc-84ca-884e3b92e45f req-2bae0206-faf6-47b5-b7c8-4460b6a0b737 service nova] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-dc548c7f-81f0-4fbc-84ca-884e3b92e45f req-2bae0206-faf6-47b5-b7c8-4460b6a0b737 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] No waiting events found dispatching network-vif-unplugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-dc548c7f-81f0-4fbc-84ca-884e3b92e45f req-2bae0206-faf6-47b5-b7c8-4460b6a0b737 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received event network-vif-unplugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Instance destroyed successfully.
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.objects.instance [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lazy-loading 'resources' on Instance uuid fe94a683-8d67-48e0-922f-41b9d90007e1 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1860053928',display_name='tempest-VolumesNegativeTest-instance-1860053928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1860053928',id=36,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:29:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b2cd47bda3841648212c2a6ffcb650b',ramdisk_id='',reservation_id='r-qtm0rxrx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2077678526',owner_user_name='tempest-VolumesNegativeTest-2077678526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:29:59Z,user_data=None,user_id='8e43ff694ce34909994e9bb3d04b0f0c',uuid=fe94a683-8d67-48e0-922f-41b9d90007e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Converting VIF {"id": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "address": "fa:16:3e:66:12:ff", "network": {"id": "4f7f4317-0408-4a47-8b7e-7ccd90e85fc7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3413d8ecba84668a83468962f5fe459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa088ead-65", "ovs_interfaceid": "fa088ead-65e0-4379-9aa4-a6a4f7f727ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=fa088ead-65e0-4379-9aa4-a6a4f7f727ac,network=Network(4f7f4317-0408-4a47-8b7e-7ccd90e85fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa088ead-65') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG os_vif [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=fa088ead-65e0-4379-9aa4-a6a4f7f727ac,network=Network(4f7f4317-0408-4a47-8b7e-7ccd90e85fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa088ead-65') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa088ead-65, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b66a7c5-0eef-487d-a490-3ccc6a85b91a) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:31:43 user nova-compute[74963]: INFO os_vif [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=fa088ead-65e0-4379-9aa4-a6a4f7f727ac,network=Network(4f7f4317-0408-4a47-8b7e-7ccd90e85fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa088ead-65')
Nov 30 08:31:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Deleting instance files /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1_del
Nov 30 08:31:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Deletion of /opt/stack/data/nova/instances/fe94a683-8d67-48e0-922f-41b9d90007e1_del complete
Nov 30 08:31:43 user nova-compute[74963]: INFO nova.compute.manager [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Detaching volume 4c844e68-548f-40f4-aeca-aa0e4b608d7a
Nov 30 08:31:43 user nova-compute[74963]: INFO nova.virt.block_device [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Attempting to driver detach volume 4c844e68-548f-40f4-aeca-aa0e4b608d7a from mountpoint /dev/vdb
Nov 30 08:31:43 user nova-compute[74963]: INFO nova.compute.manager [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 30 08:31:43 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Attempting to detach device vdb from instance 99ad690e-258d-43d1-a217-8b49cf501fa8 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:31:43 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:31:43 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:31:43 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:31:43 user nova-compute[74963]:   <serial>4c844e68-548f-40f4-aeca-aa0e4b608d7a</serial>
Nov 30 08:31:43 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:31:43 user nova-compute[74963]: </disk>
Nov 30 08:31:43 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:31:43 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully detached device vdb from instance 99ad690e-258d-43d1-a217-8b49cf501fa8 from the persistent domain config.
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99ad690e-258d-43d1-a217-8b49cf501fa8 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:31:43 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:31:43 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:31:43 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:31:43 user nova-compute[74963]:   <serial>4c844e68-548f-40f4-aeca-aa0e4b608d7a</serial>
Nov 30 08:31:43 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:31:43 user nova-compute[74963]: </disk>
Nov 30 08:31:43 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:31:43 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Took 0.48 seconds to deallocate network for instance.
Nov 30 08:31:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99ad690e-258d-43d1-a217-8b49cf501fa8 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:31:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-c73c4dc8-3168-4600-bb26-b0cebba4b596 req-763be815-6a71-4542-bb06-627186f6e163 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received event network-vif-deleted-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:31:44 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:31:44 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:31:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:44 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Deleted allocations for instance fe94a683-8d67-48e0-922f-41b9d90007e1
Nov 30 08:31:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-84c99804-1a3f-4f29-a9ce-578436bea647 tempest-VolumesNegativeTest-2077678526 tempest-VolumesNegativeTest-2077678526-project-member] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.622s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-275c19ba-2a89-464a-acf9-fae3b18cd509 req-ded2cc59-5e2e-4c7f-9446-68ca572f25c2 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received event network-vif-plugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:31:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-275c19ba-2a89-464a-acf9-fae3b18cd509 req-ded2cc59-5e2e-4c7f-9446-68ca572f25c2 service nova] Acquiring lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:31:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-275c19ba-2a89-464a-acf9-fae3b18cd509 req-ded2cc59-5e2e-4c7f-9446-68ca572f25c2 service nova] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:31:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-275c19ba-2a89-464a-acf9-fae3b18cd509 req-ded2cc59-5e2e-4c7f-9446-68ca572f25c2 service nova] Lock "fe94a683-8d67-48e0-922f-41b9d90007e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:31:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-275c19ba-2a89-464a-acf9-fae3b18cd509 req-ded2cc59-5e2e-4c7f-9446-68ca572f25c2 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] No waiting events found dispatching network-vif-plugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:31:45 user nova-compute[74963]: WARNING nova.compute.manager [req-275c19ba-2a89-464a-acf9-fae3b18cd509 req-ded2cc59-5e2e-4c7f-9446-68ca572f25c2 service nova] [instance: fe94a683-8d67-48e0-922f-41b9d90007e1] Received unexpected event network-vif-plugged-fa088ead-65e0-4379-9aa4-a6a4f7f727ac for instance with vm_state deleted and task_state None.
Nov 30 08:31:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:31:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:32:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:32:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:32:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:32:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:03 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 99ad690e-258d-43d1-a217-8b49cf501fa8 is timed out.
Nov 30 08:32:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully detached device vdb from instance 99ad690e-258d-43d1-a217-8b49cf501fa8 from the live domain config.
Nov 30 08:32:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:32:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FCBGnYMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:32:03 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:32:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:32:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:32:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b73740a-4630-4e2c-ba75-8b091f41815d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:32:04 user nova-compute[74963]: No targets found.
Nov 30 08:32:04 user nova-compute[74963]: iSNS:
Nov 30 08:32:04 user nova-compute[74963]: No targets found.
Nov 30 08:32:04 user nova-compute[74963]: STATIC:
Nov 30 08:32:04 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a
Nov 30 08:32:04 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:32:04 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:32:04 user nova-compute[74963]: FIRMWARE:
Nov 30 08:32:04 user nova-compute[74963]: No targets found.
Nov 30 08:32:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:32:04 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:32:04 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00ff982-5c5d-4437-86a5-76049ad1b36f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eae3abc-f54a-48ae-9e0c-2523a2279ea0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:32:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a (non-flash)
Nov 30 08:32:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62201caa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a'): ({'sdc'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Removing single pathed devices sdc {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a42d5ef-507b-40b8-a3ec-a6c7e1993647]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c8365f-dd23-4853-a3f4-dce74ee1af8f]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flushing IO for device /dev/sdc {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f99bcc5-83a4-46fc-97a7-ccc6e9b925de]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[04753291-5212-4e31-bc30-0ad7db007e0d]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[243b21ed-67a7-4d13-b5f1-61dde2ac8189]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f10e7e-be51-454a-87d2-65242f5d5ef4]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a, portal: 172.16.0.220,3260]
Nov 30 08:32:04 user nova-compute[74963]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a, portal: 172.16.0.220,3260] successful.
Nov 30 08:32:04 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c844e68-548f-40f4-aeca-aa0e4b608d7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd50f7c-4589-480c-b162-a62f17e8d1d0]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] <== disconnect_volume: return (280ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:32:04 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:32:05 user nova-compute[74963]: DEBUG nova.objects.instance [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'flavor' on Instance uuid 99ad690e-258d-43d1-a217-8b49cf501fa8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:32:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-48ff3aa3-f80a-4f9b-a114-716a802975cc tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.902s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:32:13 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:32:16 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:32:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:18 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:32:18 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=24.988597869873047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 99ad690e-258d-43d1-a217-8b49cf501fa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance d5e59ea5-e429-426c-b89e-17aa7115ce84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing inventories for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating ProviderTree inventory for provider 41961ac9-576a-4a02-a5e7-459f54657b3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Updating inventory in ProviderTree for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing aggregate associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, aggregates: None {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Refreshing trait associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 08:32:18 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:32:19 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:32:19 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:32:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG nova.objects.instance [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lazy-loading 'info_cache' on Instance uuid 99ad690e-258d-43d1-a217-8b49cf501fa8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updating instance_info_cache with network_info: [{"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-99ad690e-258d-43d1-a217-8b49cf501fa8" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:32:23 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:23 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:32:24 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74963) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid 99ad690e-258d-43d1-a217-8b49cf501fa8 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Triggering sync for uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:33 user nova-compute[74963]: INFO nova.compute.manager [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Terminating instance
Nov 30 08:32:33 user nova-compute[74963]: DEBUG nova.compute.manager [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG nova.compute.manager [req-ff778d78-0b7c-4d11-8857-598f670c2a88 req-ae253255-6bd5-4b33-8b1a-1d5d9422052a service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received event network-vif-unplugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ff778d78-0b7c-4d11-8857-598f670c2a88 req-ae253255-6bd5-4b33-8b1a-1d5d9422052a service nova] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ff778d78-0b7c-4d11-8857-598f670c2a88 req-ae253255-6bd5-4b33-8b1a-1d5d9422052a service nova] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ff778d78-0b7c-4d11-8857-598f670c2a88 req-ae253255-6bd5-4b33-8b1a-1d5d9422052a service nova] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG nova.compute.manager [req-ff778d78-0b7c-4d11-8857-598f670c2a88 req-ae253255-6bd5-4b33-8b1a-1d5d9422052a service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] No waiting events found dispatching network-vif-unplugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG nova.compute.manager [req-ff778d78-0b7c-4d11-8857-598f670c2a88 req-ae253255-6bd5-4b33-8b1a-1d5d9422052a service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received event network-vif-unplugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:32:34 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Instance destroyed successfully.
Nov 30 08:32:34 user nova-compute[74963]: DEBUG nova.objects.instance [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'resources' on Instance uuid 99ad690e-258d-43d1-a217-8b49cf501fa8 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1868674531',display_name='tempest-AttachVolumeNegativeTest-server-1868674531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1868674531',id=31,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm5hSmQ+GRd8TtmKVQDE5HJfeNYN4Q09jKYvNyyQrjOOX2GDi+Y8xT+SpSPFtDBQkiRHsWQIdvpdQaDp1Zn0UkqViLykNg6Ld+PszzwwKTsVjOxn0wnSOWf5997yipuLg==',key_name='tempest-keypair-1580752985',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-v908yxk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:27:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=99ad690e-258d-43d1-a217-8b49cf501fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "address": "fa:16:3e:ce:79:1a", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722c418-29", "ovs_interfaceid": "a722c418-296f-4f36-ad6c-7b20a43a7a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=a722c418-296f-4f36-ad6c-7b20a43a7a16,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722c418-29') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG os_vif [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=a722c418-296f-4f36-ad6c-7b20a43a7a16,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722c418-29') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa722c418-29, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=633ca8d5-a0d8-40a4-a8bb-017e08f196d6) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:32:34 user nova-compute[74963]: INFO os_vif [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=a722c418-296f-4f36-ad6c-7b20a43a7a16,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722c418-29')
Nov 30 08:32:34 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Deleting instance files /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8_del
Nov 30 08:32:34 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Deletion of /opt/stack/data/nova/instances/99ad690e-258d-43d1-a217-8b49cf501fa8_del complete
Nov 30 08:32:34 user nova-compute[74963]: INFO nova.compute.manager [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 30 08:32:34 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:32:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:35 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:32:35 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Took 0.81 seconds to deallocate network for instance.
Nov 30 08:32:35 user nova-compute[74963]: DEBUG nova.compute.manager [req-24424ce7-b537-467c-8581-40d17b2ec5cf req-56440c8d-b0a4-460e-9800-868b8935fae5 service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received event network-vif-deleted-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:32:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:32:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:32:35 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:32:35 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:32:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:35 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Deleted allocations for instance 99ad690e-258d-43d1-a217-8b49cf501fa8
Nov 30 08:32:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-df52911d-6a24-490e-86c5-931e68d45304 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.276s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:36 user nova-compute[74963]: DEBUG nova.compute.manager [req-66aa5021-6d41-47ec-85e6-687504d73239 req-7c6961de-5a11-44e6-b508-1439291af18e service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received event network-vif-plugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:32:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-66aa5021-6d41-47ec-85e6-687504d73239 req-7c6961de-5a11-44e6-b508-1439291af18e service nova] Acquiring lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:32:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-66aa5021-6d41-47ec-85e6-687504d73239 req-7c6961de-5a11-44e6-b508-1439291af18e service nova] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:32:36 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-66aa5021-6d41-47ec-85e6-687504d73239 req-7c6961de-5a11-44e6-b508-1439291af18e service nova] Lock "99ad690e-258d-43d1-a217-8b49cf501fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:32:36 user nova-compute[74963]: DEBUG nova.compute.manager [req-66aa5021-6d41-47ec-85e6-687504d73239 req-7c6961de-5a11-44e6-b508-1439291af18e service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] No waiting events found dispatching network-vif-plugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:32:36 user nova-compute[74963]: WARNING nova.compute.manager [req-66aa5021-6d41-47ec-85e6-687504d73239 req-7c6961de-5a11-44e6-b508-1439291af18e service nova] [instance: 99ad690e-258d-43d1-a217-8b49cf501fa8] Received unexpected event network-vif-plugged-a722c418-296f-4f36-ad6c-7b20a43a7a16 for instance with vm_state deleted and task_state None.
Nov 30 08:32:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:39 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:32:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 08:32:39 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] There are 0 instances to clean {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 08:32:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:32:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:33:01 user nova-compute[74963]: INFO nova.compute.claims [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Claim successful on node user
Nov 30 08:33:01 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:33:01 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:33:01 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:33:01 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:33:02 user nova-compute[74963]: INFO nova.virt.block_device [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Booting with volume snapshot 673fa25f-f998-4659-b5df-278cab9dc1f0 at /dev/vda
Nov 30 08:33:02 user nova-compute[74963]: DEBUG nova.policy [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '193410ba718b4232a3a4792a584f6834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5cd17a85e84d08b5b068935385ca0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:33:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:03 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Successfully created port: de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:33:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Successfully updated port: de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "refresh_cache-8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquired lock "refresh_cache-8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-78a32016-a50d-4eb3-9e3f-81e094edcfee req-d41fa658-d626-429f-b155-ebe664862196 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received event network-changed-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-78a32016-a50d-4eb3-9e3f-81e094edcfee req-d41fa658-d626-429f-b155-ebe664862196 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Refreshing instance network info cache due to event network-changed-de0927d1-046c-4648-8a2d-12530f0eb550. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-78a32016-a50d-4eb3-9e3f-81e094edcfee req-d41fa658-d626-429f-b155-ebe664862196 service nova] Acquiring lock "refresh_cache-8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.network.neutron [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Updating instance_info_cache with network_info: [{"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Releasing lock "refresh_cache-8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Instance network_info: |[{"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-78a32016-a50d-4eb3-9e3f-81e094edcfee req-d41fa658-d626-429f-b155-ebe664862196 service nova] Acquired lock "refresh_cache-8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.network.neutron [req-78a32016-a50d-4eb3-9e3f-81e094edcfee req-d41fa658-d626-429f-b155-ebe664862196 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Refreshing network info cache for port de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.network.neutron [req-78a32016-a50d-4eb3-9e3f-81e094edcfee req-d41fa658-d626-429f-b155-ebe664862196 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Updated VIF entry in instance network info cache for port de0927d1-046c-4648-8a2d-12530f0eb550. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG nova.network.neutron [req-78a32016-a50d-4eb3-9e3f-81e094edcfee req-d41fa658-d626-429f-b155-ebe664862196 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Updating instance_info_cache with network_info: [{"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-78a32016-a50d-4eb3-9e3f-81e094edcfee req-d41fa658-d626-429f-b155-ebe664862196 service nova] Releasing lock "refresh_cache-8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG os_brick.utils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9bdc66-a435-4794-8110-563576d875f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69071f6c-8416-4ce7-9b41-ad520ac864b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a938724-ff2c-4c58-bfd2-52bc1f529572]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb270f2-faf1-48d1-8647-4511422d1f65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:33:07 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:33:07 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e1606b-bbd5-47c9-bc12-4d5098e8d0d7]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG os_brick.utils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:33:07 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Updating existing volume attachment record: ca2319ba-621f-4d1a-b253-890a2bd55680 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:33:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-1de235f0-430d-4f10-b5cb-f3e2a0bd89db req-2751223d-138d-4c1d-a85c-6ea83323009d service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-changed-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-1de235f0-430d-4f10-b5cb-f3e2a0bd89db req-2751223d-138d-4c1d-a85c-6ea83323009d service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Refreshing instance network info cache due to event network-changed-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:33:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1de235f0-430d-4f10-b5cb-f3e2a0bd89db req-2751223d-138d-4c1d-a85c-6ea83323009d service nova] Acquiring lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1de235f0-430d-4f10-b5cb-f3e2a0bd89db req-2751223d-138d-4c1d-a85c-6ea83323009d service nova] Acquired lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:10 user nova-compute[74963]: DEBUG nova.network.neutron [req-1de235f0-430d-4f10-b5cb-f3e2a0bd89db req-2751223d-138d-4c1d-a85c-6ea83323009d service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Refreshing network info cache for port c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:33:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-1de235f0-430d-4f10-b5cb-f3e2a0bd89db req-2751223d-138d-4c1d-a85c-6ea83323009d service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updated VIF entry in instance network info cache for port c36b3ac9-f1fb-4f70-8954-cc14592bf6c2. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:33:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-1de235f0-430d-4f10-b5cb-f3e2a0bd89db req-2751223d-138d-4c1d-a85c-6ea83323009d service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updating instance_info_cache with network_info: [{"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-1de235f0-430d-4f10-b5cb-f3e2a0bd89db req-2751223d-138d-4c1d-a85c-6ea83323009d service nova] Releasing lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:33:14 user nova-compute[74963]: INFO nova.compute.claims [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Claim successful on node user
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:14 user nova-compute[74963]: INFO nova.compute.manager [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Shelving
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:33:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:33:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.policy [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56e0833a93c947b09b71cb3a587e219a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ac02c3deb7402aa4be7e086036e42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-723e90a7-3be5-475c-99e1-5ba80a8ed606 req-f576271f-a0a5-4f3b-92a3-9e6e7e851267 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-unplugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-723e90a7-3be5-475c-99e1-5ba80a8ed606 req-f576271f-a0a5-4f3b-92a3-9e6e7e851267 service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-723e90a7-3be5-475c-99e1-5ba80a8ed606 req-f576271f-a0a5-4f3b-92a3-9e6e7e851267 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-723e90a7-3be5-475c-99e1-5ba80a8ed606 req-f576271f-a0a5-4f3b-92a3-9e6e7e851267 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-723e90a7-3be5-475c-99e1-5ba80a8ed606 req-f576271f-a0a5-4f3b-92a3-9e6e7e851267 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-unplugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:14 user nova-compute[74963]: WARNING nova.compute.manager [req-723e90a7-3be5-475c-99e1-5ba80a8ed606 req-f576271f-a0a5-4f3b-92a3-9e6e7e851267 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-unplugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state active and task_state shelving.
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:33:14 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Creating image(s)
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "/opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "/opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.207s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.215s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance destroyed successfully.
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk 1073741824" returned: 0 in 0.074s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Beginning cold snapshot process
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.195s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk /opt/stack/data/nova/instances/snapshots/tmprsch41vy/117c499f7a034721844850de9d98dc1d {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Cannot resize image /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Ensure instance console log exists: /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Successfully created port: 7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:16 user nova-compute[74963]: WARNING nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 30 08:33:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:16 user nova-compute[74963]: WARNING nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 30 08:33:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:16 user nova-compute[74963]: WARNING nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 30 08:33:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-unplugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-unplugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:16 user nova-compute[74963]: WARNING nova.compute.manager [req-e3716db8-6e54-4eaa-aec9-a7464398bf1e req-7e2d9b3d-b028-4091-b0f1-4065c3927f69 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-unplugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:33:17 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Creating image(s)
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Ensure instance console log exists: /opt/stack/data/nova/instances/8c5ec5c2-7b07-4198-a410-aaa35e4d93c9/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Start _get_guest_xml network_info=[{"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXjxIPsh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c5ec5c2-7b07-4198-a410-aaa35e4d93c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9d87ad7-44cf-4f1b-9d06-2a6573404e88', 'serial': 'd9d87ad7-44cf-4f1b-9d06-2a6573404e88'}, 'attachment_id': 'ca2319ba-621f-4d1a-b253-890a2bd55680', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:33:17 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:17 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXjxIPsh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:33:17 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:33:17 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:33:17 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk /opt/stack/data/nova/instances/snapshots/tmprsch41vy/117c499f7a034721844850de9d98dc1d" returned: 0 in 1.523s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Snapshot extracted, beginning image upload
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[688a06fe-3f66-463a-954f-c9a605a99c0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:33:17 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Successfully updated port: 7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquired lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4746a686-217e-4eb3-a3c6-01a2418c11f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88] added
Nov 30 08:33:17 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[50075c96-65fa-4957-aa4e-b81b87ff86c8]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d3b35c-3e3f-426a-993f-c1716f800059]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXjxIPsh {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXjxIPsh" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4548a841-2721-4c13-9aa0-c7e7aaa82cf3]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KXjxIPsh'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caa9cb5-0ced-4f0e-9b1c-b76bbaf2eb8c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e74078b-00dd-4a21-9360-53e7d4702b2f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 08:33:17 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 08:33:17 user nova-compute[74963]:  {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:33:17 user nova-compute[74963]: WARNING os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 08:33:17 user nova-compute[74963]: 
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c65f00-33cb-4bee-bda0-eeb8a90e5228]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88, portal: 172.16.0.220,3260]
Nov 30 08:33:17 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88, portal: 172.16.0.220,3260] successful.
Nov 30 08:33:17 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d82c898-20f2-4b92-9d79-e6905307afca]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a357ff7-d533-46b4-bcdf-b75965515ed1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 (non-flash)
Nov 30 08:33:17 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 (non-flash)
Nov 30 08:33:17 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35a88ca-8b73-4a00-8162-da1f3f031b98]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXjxIPsh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.network.neutron [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Updating instance_info_cache with network_info: [{"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Releasing lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Instance network_info: |[{"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Start _get_guest_xml network_info=[{"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:33:17 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:17 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-541614891',display_name='tempest-VolumesSnapshotTestJSON-instance-541614891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-541614891',id=39,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM+rMyQmsArBrN9TfHVW2kV/QahmiBsFyz1hAPlEfN22mEarpc46KV4GR+Q+42DPN2pnB6TRK69Dh82imfnopcoq9FcYUVpNfTSesmpPYADN0zvFz+QuTEARzeP9uqv5A==',key_name='tempest-keypair-860867781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ac02c3deb7402aa4be7e086036e42d',ramdisk_id='',reservation_id='r-jmmv0vd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1296720269',owner_user_name='tempest-VolumesSnapshotTestJSON-1296720269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:33:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e0833a93c947b09b71cb3a587e219a',uuid=8ee12860-9fdf-44cd-94fd-dee5f0941312,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converting VIF {"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ff:4a,bridge_name='br-int',has_traffic_filtering=True,id=7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddfc647-e8') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.objects.instance [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ee12860-9fdf-44cd-94fd-dee5f0941312 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:33:17 user nova-compute[74963]:   <uuid>8ee12860-9fdf-44cd-94fd-dee5f0941312</uuid>
Nov 30 08:33:17 user nova-compute[74963]:   <name>instance-00000027</name>
Nov 30 08:33:17 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:33:17 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:33:17 user nova-compute[74963]:   <metadata>
Nov 30 08:33:17 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:33:17 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:33:17 user nova-compute[74963]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-541614891</nova:name>
Nov 30 08:33:17 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:33:17</nova:creationTime>
Nov 30 08:33:17 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:33:17 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:33:17 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:33:17 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:33:17 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:33:17 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:33:17 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:33:17 user nova-compute[74963]:       <nova:owner>
Nov 30 08:33:17 user nova-compute[74963]:         <nova:user uuid="56e0833a93c947b09b71cb3a587e219a">tempest-VolumesSnapshotTestJSON-1296720269-project-member</nova:user>
Nov 30 08:33:17 user nova-compute[74963]:         <nova:project uuid="f9ac02c3deb7402aa4be7e086036e42d">tempest-VolumesSnapshotTestJSON-1296720269</nova:project>
Nov 30 08:33:17 user nova-compute[74963]:       </nova:owner>
Nov 30 08:33:17 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:33:17 user nova-compute[74963]:       <nova:ports>
Nov 30 08:33:17 user nova-compute[74963]:         <nova:port uuid="7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497">
Nov 30 08:33:17 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 08:33:17 user nova-compute[74963]:         </nova:port>
Nov 30 08:33:17 user nova-compute[74963]:       </nova:ports>
Nov 30 08:33:17 user nova-compute[74963]:     </nova:instance>
Nov 30 08:33:17 user nova-compute[74963]:   </metadata>
Nov 30 08:33:17 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:33:17 user nova-compute[74963]:     <system>
Nov 30 08:33:17 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:33:17 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:33:17 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:33:17 user nova-compute[74963]:       <entry name="serial">8ee12860-9fdf-44cd-94fd-dee5f0941312</entry>
Nov 30 08:33:17 user nova-compute[74963]:       <entry name="uuid">8ee12860-9fdf-44cd-94fd-dee5f0941312</entry>
Nov 30 08:33:17 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:33:17 user nova-compute[74963]:     </system>
Nov 30 08:33:17 user nova-compute[74963]:   </sysinfo>
Nov 30 08:33:17 user nova-compute[74963]:   <os>
Nov 30 08:33:17 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:33:17 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:33:17 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:33:17 user nova-compute[74963]:   </os>
Nov 30 08:33:17 user nova-compute[74963]:   <features>
Nov 30 08:33:17 user nova-compute[74963]:     <acpi/>
Nov 30 08:33:17 user nova-compute[74963]:     <apic/>
Nov 30 08:33:17 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:33:17 user nova-compute[74963]:   </features>
Nov 30 08:33:17 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:33:17 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:33:17 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:33:17 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:33:17 user nova-compute[74963]:   </clock>
Nov 30 08:33:17 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:33:17 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:33:17 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:33:17 user nova-compute[74963]:   </cpu>
Nov 30 08:33:17 user nova-compute[74963]:   <devices>
Nov 30 08:33:17 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:33:17 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:33:17 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk"/>
Nov 30 08:33:17 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:33:17 user nova-compute[74963]:     </disk>
Nov 30 08:33:17 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:33:17 user nova-compute[74963]:       <mac address="fa:16:3e:0d:ff:4a"/>
Nov 30 08:33:17 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:33:17 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:33:17 user nova-compute[74963]:       <target dev="tap7ddfc647-e8"/>
Nov 30 08:33:17 user nova-compute[74963]:     </interface>
Nov 30 08:33:17 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:33:17 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/console.log" append="off"/>
Nov 30 08:33:17 user nova-compute[74963]:     </serial>
Nov 30 08:33:17 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:33:17 user nova-compute[74963]:     <video>
Nov 30 08:33:17 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:33:17 user nova-compute[74963]:     </video>
Nov 30 08:33:17 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:33:17 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:33:17 user nova-compute[74963]:     </rng>
Nov 30 08:33:17 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:33:17 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:33:17 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:33:17 user nova-compute[74963]:     </memballoon>
Nov 30 08:33:17 user nova-compute[74963]:   </devices>
Nov 30 08:33:17 user nova-compute[74963]: </domain>
Nov 30 08:33:17 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-541614891',display_name='tempest-VolumesSnapshotTestJSON-instance-541614891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-541614891',id=39,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM+rMyQmsArBrN9TfHVW2kV/QahmiBsFyz1hAPlEfN22mEarpc46KV4GR+Q+42DPN2pnB6TRK69Dh82imfnopcoq9FcYUVpNfTSesmpPYADN0zvFz+QuTEARzeP9uqv5A==',key_name='tempest-keypair-860867781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ac02c3deb7402aa4be7e086036e42d',ramdisk_id='',reservation_id='r-jmmv0vd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1296720269',owner_user_name='tempest-VolumesSnapshotTestJSON-1296720269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:33:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e0833a93c947b09b71cb3a587e219a',uuid=8ee12860-9fdf-44cd-94fd-dee5f0941312,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converting VIF {"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ff:4a,bridge_name='br-int',has_traffic_filtering=True,id=7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddfc647-e8') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG os_vif [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ff:4a,bridge_name='br-int',has_traffic_filtering=True,id=7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddfc647-e8') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c72fe007-0227-55c2-a2c0-15c7a70b6909', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ddfc647-e8, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ddfc647-e8, col_values=(('qos', UUID('bb64024b-5a15-4ac7-8031-25e449434941')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ddfc647-e8, col_values=(('external_ids', {'iface-id': '7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:ff:4a', 'vm-uuid': '8ee12860-9fdf-44cd-94fd-dee5f0941312'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:17 user nova-compute[74963]: INFO os_vif [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ff:4a,bridge_name='br-int',has_traffic_filtering=True,id=7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddfc647-e8')
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:33:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No VIF found with MAC fa:16:3e:0d:ff:4a, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23363633935393863', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363633935393863', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1383606795',display_name='tempest-TestVolumeBootPattern-server-1383606795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1383606795',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c5cd17a85e84d08b5b068935385ca0c',ramdisk_id='',reservation_id='r-k00oy450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1848886466',owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:33:02Z,user_data=None,user_id='193410ba718b4232a3a4792a584f6834',uuid=8c5ec5c2-7b07-4198-a410-aaa35e4d93c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converting VIF {"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:b7:0d,bridge_name='br-int',has_traffic_filtering=True,id=de0927d1-046c-4648-8a2d-12530f0eb550,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0927d1-04') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.objects.instance [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:33:18 user nova-compute[74963]:   <uuid>8c5ec5c2-7b07-4198-a410-aaa35e4d93c9</uuid>
Nov 30 08:33:18 user nova-compute[74963]:   <name>instance-00000026</name>
Nov 30 08:33:18 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:33:18 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:33:18 user nova-compute[74963]:   <metadata>
Nov 30 08:33:18 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:33:18 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:33:18 user nova-compute[74963]:       <nova:name>tempest-TestVolumeBootPattern-server-1383606795</nova:name>
Nov 30 08:33:18 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:33:17</nova:creationTime>
Nov 30 08:33:18 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:33:18 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:33:18 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:33:18 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:33:18 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:33:18 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:33:18 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:33:18 user nova-compute[74963]:       <nova:owner>
Nov 30 08:33:18 user nova-compute[74963]:         <nova:user uuid="193410ba718b4232a3a4792a584f6834">tempest-TestVolumeBootPattern-1848886466-project-member</nova:user>
Nov 30 08:33:18 user nova-compute[74963]:         <nova:project uuid="4c5cd17a85e84d08b5b068935385ca0c">tempest-TestVolumeBootPattern-1848886466</nova:project>
Nov 30 08:33:18 user nova-compute[74963]:       </nova:owner>
Nov 30 08:33:18 user nova-compute[74963]:       <nova:ports>
Nov 30 08:33:18 user nova-compute[74963]:         <nova:port uuid="de0927d1-046c-4648-8a2d-12530f0eb550">
Nov 30 08:33:18 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 08:33:18 user nova-compute[74963]:         </nova:port>
Nov 30 08:33:18 user nova-compute[74963]:       </nova:ports>
Nov 30 08:33:18 user nova-compute[74963]:     </nova:instance>
Nov 30 08:33:18 user nova-compute[74963]:   </metadata>
Nov 30 08:33:18 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:33:18 user nova-compute[74963]:     <system>
Nov 30 08:33:18 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:33:18 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:33:18 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:33:18 user nova-compute[74963]:       <entry name="serial">8c5ec5c2-7b07-4198-a410-aaa35e4d93c9</entry>
Nov 30 08:33:18 user nova-compute[74963]:       <entry name="uuid">8c5ec5c2-7b07-4198-a410-aaa35e4d93c9</entry>
Nov 30 08:33:18 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:33:18 user nova-compute[74963]:     </system>
Nov 30 08:33:18 user nova-compute[74963]:   </sysinfo>
Nov 30 08:33:18 user nova-compute[74963]:   <os>
Nov 30 08:33:18 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:33:18 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:33:18 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:33:18 user nova-compute[74963]:   </os>
Nov 30 08:33:18 user nova-compute[74963]:   <features>
Nov 30 08:33:18 user nova-compute[74963]:     <acpi/>
Nov 30 08:33:18 user nova-compute[74963]:     <apic/>
Nov 30 08:33:18 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:33:18 user nova-compute[74963]:   </features>
Nov 30 08:33:18 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:33:18 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:33:18 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:33:18 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:33:18 user nova-compute[74963]:   </clock>
Nov 30 08:33:18 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:33:18 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:33:18 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:33:18 user nova-compute[74963]:   </cpu>
Nov 30 08:33:18 user nova-compute[74963]:   <devices>
Nov 30 08:33:18 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:33:18 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:33:18 user nova-compute[74963]:       <source dev="/dev/sdb"/>
Nov 30 08:33:18 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:33:18 user nova-compute[74963]:       <serial>d9d87ad7-44cf-4f1b-9d06-2a6573404e88</serial>
Nov 30 08:33:18 user nova-compute[74963]:     </disk>
Nov 30 08:33:18 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:33:18 user nova-compute[74963]:       <mac address="fa:16:3e:31:b7:0d"/>
Nov 30 08:33:18 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:33:18 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:33:18 user nova-compute[74963]:       <target dev="tapde0927d1-04"/>
Nov 30 08:33:18 user nova-compute[74963]:     </interface>
Nov 30 08:33:18 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:33:18 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/8c5ec5c2-7b07-4198-a410-aaa35e4d93c9/console.log" append="off"/>
Nov 30 08:33:18 user nova-compute[74963]:     </serial>
Nov 30 08:33:18 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:33:18 user nova-compute[74963]:     <video>
Nov 30 08:33:18 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:33:18 user nova-compute[74963]:     </video>
Nov 30 08:33:18 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:33:18 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:33:18 user nova-compute[74963]:     </rng>
Nov 30 08:33:18 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:33:18 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:33:18 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:33:18 user nova-compute[74963]:     </memballoon>
Nov 30 08:33:18 user nova-compute[74963]:   </devices>
Nov 30 08:33:18 user nova-compute[74963]: </domain>
Nov 30 08:33:18 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1383606795',display_name='tempest-TestVolumeBootPattern-server-1383606795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1383606795',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c5cd17a85e84d08b5b068935385ca0c',ramdisk_id='',reservation_id='r-k00oy450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1848886466',owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:33:02Z,user_data=None,user_id='193410ba718b4232a3a4792a584f6834',uuid=8c5ec5c2-7b07-4198-a410-aaa35e4d93c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converting VIF {"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:b7:0d,bridge_name='br-int',has_traffic_filtering=True,id=de0927d1-046c-4648-8a2d-12530f0eb550,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0927d1-04') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG os_vif [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:b7:0d,bridge_name='br-int',has_traffic_filtering=True,id=de0927d1-046c-4648-8a2d-12530f0eb550,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0927d1-04') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e1c2b08-cd1f-585b-8242-9a6c0353537f', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde0927d1-04, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde0927d1-04, col_values=(('qos', UUID('14de1f21-2b98-4933-a5c3-7ca0ffb6b991')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde0927d1-04, col_values=(('external_ids', {'iface-id': 'de0927d1-046c-4648-8a2d-12530f0eb550', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:b7:0d', 'vm-uuid': '8c5ec5c2-7b07-4198-a410-aaa35e4d93c9'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:18 user nova-compute[74963]: INFO os_vif [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:b7:0d,bridge_name='br-int',has_traffic_filtering=True,id=de0927d1-046c-4648-8a2d-12530f0eb550,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0927d1-04')
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] No VIF found with MAC fa:16:3e:31:b7:0d, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.compute.manager [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.compute.manager [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:18 user nova-compute[74963]: WARNING nova.compute.manager [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.compute.manager [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-changed-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.compute.manager [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Refreshing instance network info cache due to event network-changed-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] Acquiring lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] Acquired lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:18 user nova-compute[74963]: DEBUG nova.network.neutron [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Refreshing network info cache for port 7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Updated VIF entry in instance network info cache for port 7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Updating instance_info_cache with network_info: [{"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-dc4efecd-eaf2-4f22-825f-1a5c7f818538 req-81ef3ffb-d0d2-434e-8f26-be8939049014 service nova] Releasing lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Snapshot image upload complete
Nov 30 08:33:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: INFO nova.compute.manager [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Shelve offloading
Nov 30 08:33:20 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance destroyed successfully.
Nov 30 08:33:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquired lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updating instance_info_cache with network_info: [{"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Releasing lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] No waiting events found dispatching network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:20 user nova-compute[74963]: WARNING nova.compute.manager [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received unexpected event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 for instance with vm_state building and task_state spawning.
Nov 30 08:33:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:20 user nova-compute[74963]: DEBUG nova.compute.manager [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] No waiting events found dispatching network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:20 user nova-compute[74963]: WARNING nova.compute.manager [req-3b52abdd-e4aa-4e37-9f21-f3fcc4f17586 req-4842ba54-ddc3-4a91-af9c-7118651e1edf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received unexpected event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 for instance with vm_state building and task_state spawning.
Nov 30 08:33:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-f33fd279-a63c-471b-ba37-6b73213f3f58 req-f7738119-0835-42cc-b3a2-44b6c70c387f service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received event network-vif-plugged-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f33fd279-a63c-471b-ba37-6b73213f3f58 req-f7738119-0835-42cc-b3a2-44b6c70c387f service nova] Acquiring lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f33fd279-a63c-471b-ba37-6b73213f3f58 req-f7738119-0835-42cc-b3a2-44b6c70c387f service nova] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f33fd279-a63c-471b-ba37-6b73213f3f58 req-f7738119-0835-42cc-b3a2-44b6c70c387f service nova] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG nova.compute.manager [req-f33fd279-a63c-471b-ba37-6b73213f3f58 req-f7738119-0835-42cc-b3a2-44b6c70c387f service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] No waiting events found dispatching network-vif-plugged-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:21 user nova-compute[74963]: WARNING nova.compute.manager [req-f33fd279-a63c-471b-ba37-6b73213f3f58 req-f7738119-0835-42cc-b3a2-44b6c70c387f service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received unexpected event network-vif-plugged-de0927d1-046c-4648-8a2d-12530f0eb550 for instance with vm_state building and task_state spawning.
Nov 30 08:33:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:21 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance destroyed successfully.
Nov 30 08:33:21 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'resources' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1988636161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1988636161',id=37,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPd4ASO80Kxi3NHD7OzgG3rXjragYl5NaXFAooh4ILUBXsjowt7I1YJBq0LOLUQMt8ITVotCYy3URmr4FfibwpVsXxiCTTUY3cIEhaGOBJ0iKmY0rHDe3iKGQAj7fVjtg==',key_name='tempest-keypair-1641280519',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:31:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='36c9009714354721a7697c14258ffc7d',ramdisk_id='',reservation_id='r-lytpxy1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1943160204',owner_user_name='tempest-AttachVolumeShelveTestJSON-1943160204-project-member',shelved_at='2023-11-30T08:33:20.217700',shelved_host='user',shelved_image_id='63efb6a8-48ac-42d2-a8e7-141d9975b855'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad49a6fbce944b719e6f09a5e2bd1b30',uuid=d5e59ea5-e429-426c-b89e-17aa7115ce84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converting VIF {"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG os_vif [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc36b3ac9-f1, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec673194-a130-4841-9ab0-2f2618513f2d) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:21 user nova-compute[74963]: INFO os_vif [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1')
Nov 30 08:33:21 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Deleting instance files /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84_del
Nov 30 08:33:21 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Deletion of /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84_del complete
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json" returned: 1 in 0.194s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:33:21 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000025, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:21 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Deleted allocations for instance d5e59ea5-e429-426c-b89e-17aa7115ce84
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'numa_topology' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:33:21 user nova-compute[74963]: DEBUG nova.objects.base [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Object Instance<d5e59ea5-e429-426c-b89e-17aa7115ce84> lazy-loaded attributes: resources,numa_topology {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:33:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:22 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:33:22 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:33:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8a9807b2-c3f1-48d4-a746-f2ecba345569 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.874s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-8fff6a95-76ec-4ae6-8e17-086255b7af97 req-f34ff9de-f972-4d0f-8ebb-0567958433c7 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received event network-vif-plugged-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8fff6a95-76ec-4ae6-8e17-086255b7af97 req-f34ff9de-f972-4d0f-8ebb-0567958433c7 service nova] Acquiring lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8fff6a95-76ec-4ae6-8e17-086255b7af97 req-f34ff9de-f972-4d0f-8ebb-0567958433c7 service nova] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8fff6a95-76ec-4ae6-8e17-086255b7af97 req-f34ff9de-f972-4d0f-8ebb-0567958433c7 service nova] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.manager [req-8fff6a95-76ec-4ae6-8e17-086255b7af97 req-f34ff9de-f972-4d0f-8ebb-0567958433c7 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] No waiting events found dispatching network-vif-plugged-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:23 user nova-compute[74963]: WARNING nova.compute.manager [req-8fff6a95-76ec-4ae6-8e17-086255b7af97 req-f34ff9de-f972-4d0f-8ebb-0567958433c7 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received unexpected event network-vif-plugged-de0927d1-046c-4648-8a2d-12530f0eb550 for instance with vm_state building and task_state spawning.
Nov 30 08:33:23 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Instance spawned successfully.
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:33:23 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:23 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=25.279335021972656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:23 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Instance spawned successfully.
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 8ee12860-9fdf-44cd-94fd-dee5f0941312 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:33:23 user nova-compute[74963]: INFO nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Took 8.71 seconds to spawn the instance on the hypervisor.
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:33:23 user nova-compute[74963]: INFO nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:33:23 user nova-compute[74963]: INFO nova.compute.manager [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Took 9.42 seconds to build instance.
Nov 30 08:33:23 user nova-compute[74963]: INFO nova.compute.manager [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Took 22.03 seconds to build instance.
Nov 30 08:33:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-ece67f1f-68de-4f7b-bf60-580d6d18bbb0 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.526s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c036abf6-7b01-4475-b3cd-435ffa4a78e3 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.137s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Didn't find any instances for network info cache update. {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:33:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:33:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:27 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:28 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:33:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:28 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:33:28 user nova-compute[74963]: INFO nova.compute.claims [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Claim successful on node user
Nov 30 08:33:29 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:33:29 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:33:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG nova.policy [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '960072c79ce2402d83f2d6fba0bf77de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2164e77b2f554d9b8eecac876545849b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:33:29 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Creating image(s)
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "/opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "/opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "/opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.190s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk 1073741824" returned: 0 in 0.059s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:29 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Successfully created port: cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Cannot resize image /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Ensure instance console log exists: /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Successfully updated port: cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquired lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.compute.manager [req-2b306c7e-38ad-44a3-a7e9-5d86980770f5 req-cd73f5dd-0b9b-42dd-a625-c8880d519fd3 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received event network-changed-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.compute.manager [req-2b306c7e-38ad-44a3-a7e9-5d86980770f5 req-cd73f5dd-0b9b-42dd-a625-c8880d519fd3 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Refreshing instance network info cache due to event network-changed-cd8de7e3-a358-48ab-9604-4b126ba45146. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2b306c7e-38ad-44a3-a7e9-5d86980770f5 req-cd73f5dd-0b9b-42dd-a625-c8880d519fd3 service nova] Acquiring lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:30 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Updating instance_info_cache with network_info: [{"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Releasing lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Instance network_info: |[{"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2b306c7e-38ad-44a3-a7e9-5d86980770f5 req-cd73f5dd-0b9b-42dd-a625-c8880d519fd3 service nova] Acquired lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.network.neutron [req-2b306c7e-38ad-44a3-a7e9-5d86980770f5 req-cd73f5dd-0b9b-42dd-a625-c8880d519fd3 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Refreshing network info cache for port cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Start _get_guest_xml network_info=[{"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:33:31 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:31 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-332900270',display_name='tempest-AttachVolumeNegativeTest-server-332900270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-332900270',id=40,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADo7hF0AK/jTDyTmuEivZFTK85mszHcngtA9nHbpQFpvwI07uSjelrLBTZIVdwQ4pWafvsFkasBFH2amVPfLlQ1NPjBPxhspz8KkJUqo4bmYdCJKiHBoSeF7J0b44bpSw==',key_name='tempest-keypair-998302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-jmwnqksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=89a37a46-76ec-4166-bb1d-c4b50a544bc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d4:45,bridge_name='br-int',has_traffic_filtering=True,id=cd8de7e3-a358-48ab-9604-4b126ba45146,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8de7e3-a3') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'pci_devices' on Instance uuid 89a37a46-76ec-4166-bb1d-c4b50a544bc9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:33:31 user nova-compute[74963]:   <uuid>89a37a46-76ec-4166-bb1d-c4b50a544bc9</uuid>
Nov 30 08:33:31 user nova-compute[74963]:   <name>instance-00000028</name>
Nov 30 08:33:31 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:33:31 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:33:31 user nova-compute[74963]:   <metadata>
Nov 30 08:33:31 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:33:31 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:33:31 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeNegativeTest-server-332900270</nova:name>
Nov 30 08:33:31 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:33:31</nova:creationTime>
Nov 30 08:33:31 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:33:31 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:33:31 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:33:31 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:33:31 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:33:31 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:33:31 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:33:31 user nova-compute[74963]:       <nova:owner>
Nov 30 08:33:31 user nova-compute[74963]:         <nova:user uuid="960072c79ce2402d83f2d6fba0bf77de">tempest-AttachVolumeNegativeTest-1676573190-project-member</nova:user>
Nov 30 08:33:31 user nova-compute[74963]:         <nova:project uuid="2164e77b2f554d9b8eecac876545849b">tempest-AttachVolumeNegativeTest-1676573190</nova:project>
Nov 30 08:33:31 user nova-compute[74963]:       </nova:owner>
Nov 30 08:33:31 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:33:31 user nova-compute[74963]:       <nova:ports>
Nov 30 08:33:31 user nova-compute[74963]:         <nova:port uuid="cd8de7e3-a358-48ab-9604-4b126ba45146">
Nov 30 08:33:31 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 08:33:31 user nova-compute[74963]:         </nova:port>
Nov 30 08:33:31 user nova-compute[74963]:       </nova:ports>
Nov 30 08:33:31 user nova-compute[74963]:     </nova:instance>
Nov 30 08:33:31 user nova-compute[74963]:   </metadata>
Nov 30 08:33:31 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:33:31 user nova-compute[74963]:     <system>
Nov 30 08:33:31 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:33:31 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:33:31 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:33:31 user nova-compute[74963]:       <entry name="serial">89a37a46-76ec-4166-bb1d-c4b50a544bc9</entry>
Nov 30 08:33:31 user nova-compute[74963]:       <entry name="uuid">89a37a46-76ec-4166-bb1d-c4b50a544bc9</entry>
Nov 30 08:33:31 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:33:31 user nova-compute[74963]:     </system>
Nov 30 08:33:31 user nova-compute[74963]:   </sysinfo>
Nov 30 08:33:31 user nova-compute[74963]:   <os>
Nov 30 08:33:31 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:33:31 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:33:31 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:33:31 user nova-compute[74963]:   </os>
Nov 30 08:33:31 user nova-compute[74963]:   <features>
Nov 30 08:33:31 user nova-compute[74963]:     <acpi/>
Nov 30 08:33:31 user nova-compute[74963]:     <apic/>
Nov 30 08:33:31 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:33:31 user nova-compute[74963]:   </features>
Nov 30 08:33:31 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:33:31 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:33:31 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:33:31 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:33:31 user nova-compute[74963]:   </clock>
Nov 30 08:33:31 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:33:31 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:33:31 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:33:31 user nova-compute[74963]:   </cpu>
Nov 30 08:33:31 user nova-compute[74963]:   <devices>
Nov 30 08:33:31 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:33:31 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:33:31 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk"/>
Nov 30 08:33:31 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:33:31 user nova-compute[74963]:     </disk>
Nov 30 08:33:31 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:33:31 user nova-compute[74963]:       <mac address="fa:16:3e:5a:d4:45"/>
Nov 30 08:33:31 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:33:31 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:33:31 user nova-compute[74963]:       <target dev="tapcd8de7e3-a3"/>
Nov 30 08:33:31 user nova-compute[74963]:     </interface>
Nov 30 08:33:31 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:33:31 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/console.log" append="off"/>
Nov 30 08:33:31 user nova-compute[74963]:     </serial>
Nov 30 08:33:31 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:33:31 user nova-compute[74963]:     <video>
Nov 30 08:33:31 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:33:31 user nova-compute[74963]:     </video>
Nov 30 08:33:31 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:33:31 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:33:31 user nova-compute[74963]:     </rng>
Nov 30 08:33:31 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:33:31 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:33:31 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:33:31 user nova-compute[74963]:     </memballoon>
Nov 30 08:33:31 user nova-compute[74963]:   </devices>
Nov 30 08:33:31 user nova-compute[74963]: </domain>
Nov 30 08:33:31 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-332900270',display_name='tempest-AttachVolumeNegativeTest-server-332900270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-332900270',id=40,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADo7hF0AK/jTDyTmuEivZFTK85mszHcngtA9nHbpQFpvwI07uSjelrLBTZIVdwQ4pWafvsFkasBFH2amVPfLlQ1NPjBPxhspz8KkJUqo4bmYdCJKiHBoSeF7J0b44bpSw==',key_name='tempest-keypair-998302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-jmwnqksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=89a37a46-76ec-4166-bb1d-c4b50a544bc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d4:45,bridge_name='br-int',has_traffic_filtering=True,id=cd8de7e3-a358-48ab-9604-4b126ba45146,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8de7e3-a3') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG os_vif [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d4:45,bridge_name='br-int',has_traffic_filtering=True,id=cd8de7e3-a358-48ab-9604-4b126ba45146,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8de7e3-a3') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '583c8c4e-92d0-5773-af60-08da42652dee', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd8de7e3-a3, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd8de7e3-a3, col_values=(('qos', UUID('458b3dbd-b659-47e9-a3e4-7c9813777dfb')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd8de7e3-a3, col_values=(('external_ids', {'iface-id': 'cd8de7e3-a358-48ab-9604-4b126ba45146', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:d4:45', 'vm-uuid': '89a37a46-76ec-4166-bb1d-c4b50a544bc9'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:31 user nova-compute[74963]: INFO os_vif [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d4:45,bridge_name='br-int',has_traffic_filtering=True,id=cd8de7e3-a358-48ab-9604-4b126ba45146,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8de7e3-a3')
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No VIF found with MAC fa:16:3e:5a:d4:45, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.network.neutron [req-2b306c7e-38ad-44a3-a7e9-5d86980770f5 req-cd73f5dd-0b9b-42dd-a625-c8880d519fd3 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Updated VIF entry in instance network info cache for port cd8de7e3-a358-48ab-9604-4b126ba45146. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG nova.network.neutron [req-2b306c7e-38ad-44a3-a7e9-5d86980770f5 req-cd73f5dd-0b9b-42dd-a625-c8880d519fd3 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Updating instance_info_cache with network_info: [{"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:31 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2b306c7e-38ad-44a3-a7e9-5d86980770f5 req-cd73f5dd-0b9b-42dd-a625-c8880d519fd3 service nova] Releasing lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:32 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:33:35 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Instance spawned successfully.
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:35 user nova-compute[74963]: INFO nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 30 08:33:35 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:33:35 user nova-compute[74963]: INFO nova.compute.manager [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Took 6.58 seconds to build instance.
Nov 30 08:33:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e89f5850-ae47-4838-8bcb-45f2ce5cf9b9 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.715s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:33:37 user nova-compute[74963]: INFO nova.compute.claims [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Claim successful on node user
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:33:37 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.policy [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6ad4469500b4c01a5ddf6bf2208e955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4df22008114c12b02eff15a5b3c228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:33:37 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Creating image(s)
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "/opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "/opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "/opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "e2b602f049916319c34c69846ade6565109f0e9c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:37 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "e2b602f049916319c34c69846ade6565109f0e9c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c.part --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:38 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Successfully created port: d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:33:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c.part --force-share --output=json" returned: 0 in 0.345s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:38 user nova-compute[74963]: DEBUG nova.virt.images [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] 438ac9a9-7c77-4030-b963-c9bb079ae8fa was qcow2, converting to raw {{(pid=74963) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 08:33:38 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:33:38 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c.part /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c.converted {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c.part /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c.converted" returned: 0 in 0.475s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c.converted --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG nova.compute.manager [req-e997f8ca-92a6-427a-a45f-4720689c5338 req-1a06a4a6-f252-460a-b1a2-569f8fe8d50b service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received event network-vif-plugged-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e997f8ca-92a6-427a-a45f-4720689c5338 req-1a06a4a6-f252-460a-b1a2-569f8fe8d50b service nova] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e997f8ca-92a6-427a-a45f-4720689c5338 req-1a06a4a6-f252-460a-b1a2-569f8fe8d50b service nova] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e997f8ca-92a6-427a-a45f-4720689c5338 req-1a06a4a6-f252-460a-b1a2-569f8fe8d50b service nova] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG nova.compute.manager [req-e997f8ca-92a6-427a-a45f-4720689c5338 req-1a06a4a6-f252-460a-b1a2-569f8fe8d50b service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] No waiting events found dispatching network-vif-plugged-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:39 user nova-compute[74963]: WARNING nova.compute.manager [req-e997f8ca-92a6-427a-a45f-4720689c5338 req-1a06a4a6-f252-460a-b1a2-569f8fe8d50b service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received unexpected event network-vif-plugged-cd8de7e3-a358-48ab-9604-4b126ba45146 for instance with vm_state active and task_state None.
Nov 30 08:33:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c.converted --force-share --output=json" returned: 0 in 0.277s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "e2b602f049916319c34c69846ade6565109f0e9c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.831s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c --force-share --output=json" returned: 0 in 0.208s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "e2b602f049916319c34c69846ade6565109f0e9c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "e2b602f049916319c34c69846ade6565109f0e9c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c --force-share --output=json" returned: 0 in 0.225s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c,backing_fmt=raw /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c,backing_fmt=raw /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk 1073741824" returned: 0 in 0.133s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "e2b602f049916319c34c69846ade6565109f0e9c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c --force-share --output=json" returned: 0 in 0.250s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Cannot resize image /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Ensure instance console log exists: /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Successfully updated port: d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquired lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:33:40 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.network.neutron [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Releasing lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Instance network_info: |[{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Start _get_guest_xml network_info=[{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:33:34Z,direct_url=<?>,disk_format='qcow2',id=438ac9a9-7c77-4030-b963-c9bb079ae8fa,min_disk=0,min_ram=0,name='tempest-scenario-img--897555649',owner='3a4df22008114c12b02eff15a5b3c228',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:33:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': '438ac9a9-7c77-4030-b963-c9bb079ae8fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:33:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:33:34Z,direct_url=<?>,disk_format='qcow2',id=438ac9a9-7c77-4030-b963-c9bb079ae8fa,min_disk=0,min_ram=0,name='tempest-scenario-img--897555649',owner='3a4df22008114c12b02eff15a5b3c228',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:33:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-350375214',display_name='tempest-TestMinimumBasicScenario-server-350375214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-350375214',id=41,image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNTMdTZqGdn5fGGpuwmipL8JAwunkj6tNUcOg3KCk39VwIlTZ5bPaPdjgX29N8YB3Kn8ib9NsNjsSE3qN3tlCeA2Alp233wU5LJH2Ce5RAQobujjVxxwOiWHItwL02og==',key_name='tempest-TestMinimumBasicScenario-1406737130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a4df22008114c12b02eff15a5b3c228',ramdisk_id='',reservation_id='r-jj18c6oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-171021974',owner_user_name='tempest-TestMinimumBasicScenario-171021974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:33:38Z,user_data=None,user_id='c6ad4469500b4c01a5ddf6bf2208e955',uuid=852f07b2-063c-4225-ba5d-2aa8fd25ea5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converting VIF {"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'pci_devices' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:33:41 user nova-compute[74963]:   <uuid>852f07b2-063c-4225-ba5d-2aa8fd25ea5c</uuid>
Nov 30 08:33:41 user nova-compute[74963]:   <name>instance-00000029</name>
Nov 30 08:33:41 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:33:41 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:33:41 user nova-compute[74963]:   <metadata>
Nov 30 08:33:41 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:33:41 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:33:41 user nova-compute[74963]:       <nova:name>tempest-TestMinimumBasicScenario-server-350375214</nova:name>
Nov 30 08:33:41 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:33:41</nova:creationTime>
Nov 30 08:33:41 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:33:41 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:33:41 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:33:41 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:33:41 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:33:41 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:33:41 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:33:41 user nova-compute[74963]:       <nova:owner>
Nov 30 08:33:41 user nova-compute[74963]:         <nova:user uuid="c6ad4469500b4c01a5ddf6bf2208e955">tempest-TestMinimumBasicScenario-171021974-project-member</nova:user>
Nov 30 08:33:41 user nova-compute[74963]:         <nova:project uuid="3a4df22008114c12b02eff15a5b3c228">tempest-TestMinimumBasicScenario-171021974</nova:project>
Nov 30 08:33:41 user nova-compute[74963]:       </nova:owner>
Nov 30 08:33:41 user nova-compute[74963]:       <nova:root type="image" uuid="438ac9a9-7c77-4030-b963-c9bb079ae8fa"/>
Nov 30 08:33:41 user nova-compute[74963]:       <nova:ports>
Nov 30 08:33:41 user nova-compute[74963]:         <nova:port uuid="d971edba-1059-4e1c-a701-aee51ab5cd59">
Nov 30 08:33:41 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 08:33:41 user nova-compute[74963]:         </nova:port>
Nov 30 08:33:41 user nova-compute[74963]:       </nova:ports>
Nov 30 08:33:41 user nova-compute[74963]:     </nova:instance>
Nov 30 08:33:41 user nova-compute[74963]:   </metadata>
Nov 30 08:33:41 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:33:41 user nova-compute[74963]:     <system>
Nov 30 08:33:41 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:33:41 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:33:41 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:33:41 user nova-compute[74963]:       <entry name="serial">852f07b2-063c-4225-ba5d-2aa8fd25ea5c</entry>
Nov 30 08:33:41 user nova-compute[74963]:       <entry name="uuid">852f07b2-063c-4225-ba5d-2aa8fd25ea5c</entry>
Nov 30 08:33:41 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:33:41 user nova-compute[74963]:     </system>
Nov 30 08:33:41 user nova-compute[74963]:   </sysinfo>
Nov 30 08:33:41 user nova-compute[74963]:   <os>
Nov 30 08:33:41 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:33:41 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:33:41 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:33:41 user nova-compute[74963]:   </os>
Nov 30 08:33:41 user nova-compute[74963]:   <features>
Nov 30 08:33:41 user nova-compute[74963]:     <acpi/>
Nov 30 08:33:41 user nova-compute[74963]:     <apic/>
Nov 30 08:33:41 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:33:41 user nova-compute[74963]:   </features>
Nov 30 08:33:41 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:33:41 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:33:41 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:33:41 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:33:41 user nova-compute[74963]:   </clock>
Nov 30 08:33:41 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:33:41 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:33:41 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:33:41 user nova-compute[74963]:   </cpu>
Nov 30 08:33:41 user nova-compute[74963]:   <devices>
Nov 30 08:33:41 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:33:41 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:33:41 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk"/>
Nov 30 08:33:41 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:33:41 user nova-compute[74963]:     </disk>
Nov 30 08:33:41 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:33:41 user nova-compute[74963]:       <mac address="fa:16:3e:27:b5:61"/>
Nov 30 08:33:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:33:41 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:33:41 user nova-compute[74963]:       <target dev="tapd971edba-10"/>
Nov 30 08:33:41 user nova-compute[74963]:     </interface>
Nov 30 08:33:41 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:33:41 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/console.log" append="off"/>
Nov 30 08:33:41 user nova-compute[74963]:     </serial>
Nov 30 08:33:41 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:33:41 user nova-compute[74963]:     <video>
Nov 30 08:33:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:33:41 user nova-compute[74963]:     </video>
Nov 30 08:33:41 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:33:41 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:33:41 user nova-compute[74963]:     </rng>
Nov 30 08:33:41 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:33:41 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:33:41 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:33:41 user nova-compute[74963]:     </memballoon>
Nov 30 08:33:41 user nova-compute[74963]:   </devices>
Nov 30 08:33:41 user nova-compute[74963]: </domain>
Nov 30 08:33:41 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-350375214',display_name='tempest-TestMinimumBasicScenario-server-350375214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-350375214',id=41,image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNTMdTZqGdn5fGGpuwmipL8JAwunkj6tNUcOg3KCk39VwIlTZ5bPaPdjgX29N8YB3Kn8ib9NsNjsSE3qN3tlCeA2Alp233wU5LJH2Ce5RAQobujjVxxwOiWHItwL02og==',key_name='tempest-TestMinimumBasicScenario-1406737130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a4df22008114c12b02eff15a5b3c228',ramdisk_id='',reservation_id='r-jj18c6oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-171021974',owner_user_name='tempest-TestMinimumBasicScenario-171021974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:33:38Z,user_data=None,user_id='c6ad4469500b4c01a5ddf6bf2208e955',uuid=852f07b2-063c-4225-ba5d-2aa8fd25ea5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converting VIF {"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG os_vif [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94d2a8e1-4786-5abc-b28d-34c6bf329756', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd971edba-10, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd971edba-10, col_values=(('qos', UUID('576a77fc-319f-44f5-8013-63db680998d1')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd971edba-10, col_values=(('external_ids', {'iface-id': 'd971edba-1059-4e1c-a701-aee51ab5cd59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:b5:61', 'vm-uuid': '852f07b2-063c-4225-ba5d-2aa8fd25ea5c'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:41 user nova-compute[74963]: INFO os_vif [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10')
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] No VIF found with MAC fa:16:3e:27:b5:61, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received event network-vif-plugged-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] No waiting events found dispatching network-vif-plugged-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:41 user nova-compute[74963]: WARNING nova.compute.manager [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received unexpected event network-vif-plugged-cd8de7e3-a358-48ab-9604-4b126ba45146 for instance with vm_state active and task_state None.
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.compute.manager [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing instance network info cache due to event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] Acquiring lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] Acquired lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:33:41 user nova-compute[74963]: DEBUG nova.network.neutron [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:33:42 user nova-compute[74963]: DEBUG nova.network.neutron [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updated VIF entry in instance network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:33:42 user nova-compute[74963]: DEBUG nova.network.neutron [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:33:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f75fe422-dbb0-4964-b8f5-8d70da7450f8 req-d633c82c-c624-47ee-8ae2-351e0ce8555f service nova] Releasing lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:33:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-cccad4f2-7cc2-4d35-a54b-cd74268fc415 req-70cd7955-2da4-438f-bf4c-3677d007fea9 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cccad4f2-7cc2-4d35-a54b-cd74268fc415 req-70cd7955-2da4-438f-bf4c-3677d007fea9 service nova] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cccad4f2-7cc2-4d35-a54b-cd74268fc415 req-70cd7955-2da4-438f-bf4c-3677d007fea9 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cccad4f2-7cc2-4d35-a54b-cd74268fc415 req-70cd7955-2da4-438f-bf4c-3677d007fea9 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-cccad4f2-7cc2-4d35-a54b-cd74268fc415 req-70cd7955-2da4-438f-bf4c-3677d007fea9 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] No waiting events found dispatching network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:43 user nova-compute[74963]: WARNING nova.compute.manager [req-cccad4f2-7cc2-4d35-a54b-cd74268fc415 req-70cd7955-2da4-438f-bf4c-3677d007fea9 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received unexpected event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 for instance with vm_state building and task_state spawning.
Nov 30 08:33:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:33:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:33:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Instance spawned successfully.
Nov 30 08:33:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:33:45 user nova-compute[74963]: INFO nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Took 7.18 seconds to spawn the instance on the hypervisor.
Nov 30 08:33:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:33:45 user nova-compute[74963]: INFO nova.compute.manager [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Took 7.88 seconds to build instance.
Nov 30 08:33:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-169d0c00-1407-4804-9657-a75751766184 req-376419bd-daca-4f07-a629-ae958e16431b service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-169d0c00-1407-4804-9657-a75751766184 req-376419bd-daca-4f07-a629-ae958e16431b service nova] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-169d0c00-1407-4804-9657-a75751766184 req-376419bd-daca-4f07-a629-ae958e16431b service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-169d0c00-1407-4804-9657-a75751766184 req-376419bd-daca-4f07-a629-ae958e16431b service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-169d0c00-1407-4804-9657-a75751766184 req-376419bd-daca-4f07-a629-ae958e16431b service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] No waiting events found dispatching network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:33:45 user nova-compute[74963]: WARNING nova.compute.manager [req-169d0c00-1407-4804-9657-a75751766184 req-376419bd-daca-4f07-a629-ae958e16431b service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received unexpected event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 for instance with vm_state active and task_state None.
Nov 30 08:33:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-3bf38bc6-b72a-45bb-bd31-2892352ac0e1 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.988s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:33:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:33:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:06 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:19 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:20 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:21 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:34:21 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:34:21 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8203MB free_disk=25.150123596191406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 8ee12860-9fdf-44cd-94fd-dee5f0941312 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:34:21 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:34:22 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:34:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG nova.objects.instance [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lazy-loading 'info_cache' on Instance uuid 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Updating instance_info_cache with network_info: [{"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:23 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:34:24 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:34:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:34:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:34:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:34:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:34:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:34:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:34:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:34:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:34:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:34:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:34:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:34:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:34:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:34:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:34:52 user nova-compute[74963]: INFO nova.compute.manager [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Terminating instance
Nov 30 08:34:52 user nova-compute[74963]: DEBUG nova.compute.manager [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-9efb88f9-deb9-4ced-98bf-36084e39dc66 req-da4fc9c8-3aeb-469b-8591-56d45175cf72 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received event network-vif-unplugged-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9efb88f9-deb9-4ced-98bf-36084e39dc66 req-da4fc9c8-3aeb-469b-8591-56d45175cf72 service nova] Acquiring lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9efb88f9-deb9-4ced-98bf-36084e39dc66 req-da4fc9c8-3aeb-469b-8591-56d45175cf72 service nova] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-9efb88f9-deb9-4ced-98bf-36084e39dc66 req-da4fc9c8-3aeb-469b-8591-56d45175cf72 service nova] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-9efb88f9-deb9-4ced-98bf-36084e39dc66 req-da4fc9c8-3aeb-469b-8591-56d45175cf72 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] No waiting events found dispatching network-vif-unplugged-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-9efb88f9-deb9-4ced-98bf-36084e39dc66 req-da4fc9c8-3aeb-469b-8591-56d45175cf72 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received event network-vif-unplugged-de0927d1-046c-4648-8a2d-12530f0eb550 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Instance destroyed successfully.
Nov 30 08:34:52 user nova-compute[74963]: DEBUG nova.objects.instance [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lazy-loading 'resources' on Instance uuid 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1383606795',display_name='tempest-TestVolumeBootPattern-server-1383606795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1383606795',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c5cd17a85e84d08b5b068935385ca0c',ramdisk_id='',reservation_id='r-k00oy450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1848886466',owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:33:24Z,user_data=None,user_id='193410ba718b4232a3a4792a584f6834',uuid=8c5ec5c2-7b07-4198-a410-aaa35e4d93c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converting VIF {"id": "de0927d1-046c-4648-8a2d-12530f0eb550", "address": "fa:16:3e:31:b7:0d", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0927d1-04", "ovs_interfaceid": "de0927d1-046c-4648-8a2d-12530f0eb550", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:b7:0d,bridge_name='br-int',has_traffic_filtering=True,id=de0927d1-046c-4648-8a2d-12530f0eb550,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0927d1-04') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG os_vif [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:b7:0d,bridge_name='br-int',has_traffic_filtering=True,id=de0927d1-046c-4648-8a2d-12530f0eb550,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0927d1-04') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde0927d1-04, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14de1f21-2b98-4933-a5c3-7ca0ffb6b991) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:34:52 user nova-compute[74963]: INFO os_vif [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:b7:0d,bridge_name='br-int',has_traffic_filtering=True,id=de0927d1-046c-4648-8a2d-12530f0eb550,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0927d1-04')
Nov 30 08:34:52 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXjxIPsh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:34:52 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:34:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0406184c-71a1-417b-adc6-1a0b9a1ebcdd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:34:52 user nova-compute[74963]: No targets found.
Nov 30 08:34:52 user nova-compute[74963]: iSNS:
Nov 30 08:34:52 user nova-compute[74963]: No targets found.
Nov 30 08:34:52 user nova-compute[74963]: STATIC:
Nov 30 08:34:52 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88
Nov 30 08:34:52 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:34:52 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:34:52 user nova-compute[74963]: FIRMWARE:
Nov 30 08:34:52 user nova-compute[74963]: No targets found.
Nov 30 08:34:52 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:34:52 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:34:52 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2aa42c-f942-45a2-b2a2-1455d0b8ada5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:52 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2431ed11-a2aa-400f-a3b5-13527c327c58]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 (non-flash)
Nov 30 08:34:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 (non-flash)
Nov 30 08:34:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62207985e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab276099-c206-4dfe-9e6f-7ffde96fe198]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b3195e-162e-422a-9aa9-403704bf204e]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e3f568-42fa-4063-925f-4da278df8f4f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba3622d-8ab0-4745-b863-a4d1e89ed7cd]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e9a88220', '/dev/disk/by-id/scsi-1SCST_BIOe9a88220-3cc9598c1819f46f', '/dev/disk/by-id/scsi-23363633935393863') {{(pid=86506) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa655352-9cc1-4cce-a312-ed926f04a579]: (4, None) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b51f215-42b3-48a2-a799-f0dfae09d71b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcadb67e-f12e-4a93-b468-a2bfa6cb28d0]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88, portal: 172.16.0.220,3260]
Nov 30 08:34:53 user nova-compute[74963]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88, portal: 172.16.0.220,3260] successful.
Nov 30 08:34:53 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d87ad7-44cf-4f1b-9d06-2a6573404e88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[42416ce9-657d-46cf-8e7e-5dda0297ce22]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] <== disconnect_volume: return (351ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:34:53 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Deleting instance files /opt/stack/data/nova/instances/8c5ec5c2-7b07-4198-a410-aaa35e4d93c9_del
Nov 30 08:34:53 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Deletion of /opt/stack/data/nova/instances/8c5ec5c2-7b07-4198-a410-aaa35e4d93c9_del complete
Nov 30 08:34:53 user nova-compute[74963]: INFO nova.compute.manager [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 30 08:34:53 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:34:53 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Took 0.40 seconds to deallocate network for instance.
Nov 30 08:34:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-da147764-2235-4292-b029-c83c15b47fee req-8613d86c-4af4-4712-b8dd-c3b1b2924f32 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received event network-vif-deleted-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:34:53 user nova-compute[74963]: INFO nova.compute.manager [req-da147764-2235-4292-b029-c83c15b47fee req-8613d86c-4af4-4712-b8dd-c3b1b2924f32 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Neutron deleted interface de0927d1-046c-4648-8a2d-12530f0eb550; detaching it from the instance and deleting it from the info cache
Nov 30 08:34:53 user nova-compute[74963]: DEBUG nova.network.neutron [req-da147764-2235-4292-b029-c83c15b47fee req-8613d86c-4af4-4712-b8dd-c3b1b2924f32 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:34:53 user nova-compute[74963]: DEBUG nova.compute.manager [req-da147764-2235-4292-b029-c83c15b47fee req-8613d86c-4af4-4712-b8dd-c3b1b2924f32 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Detach interface failed, port_id=de0927d1-046c-4648-8a2d-12530f0eb550, reason: Instance 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9 could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-d84b9a1e-bc36-4ea0-9d79-5bbee7ce5a44 req-fe11cb13-d1df-4617-acc2-d8ceb48e0b88 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received event network-vif-plugged-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d84b9a1e-bc36-4ea0-9d79-5bbee7ce5a44 req-fe11cb13-d1df-4617-acc2-d8ceb48e0b88 service nova] Acquiring lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d84b9a1e-bc36-4ea0-9d79-5bbee7ce5a44 req-fe11cb13-d1df-4617-acc2-d8ceb48e0b88 service nova] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d84b9a1e-bc36-4ea0-9d79-5bbee7ce5a44 req-fe11cb13-d1df-4617-acc2-d8ceb48e0b88 service nova] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG nova.compute.manager [req-d84b9a1e-bc36-4ea0-9d79-5bbee7ce5a44 req-fe11cb13-d1df-4617-acc2-d8ceb48e0b88 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] No waiting events found dispatching network-vif-plugged-de0927d1-046c-4648-8a2d-12530f0eb550 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:34:54 user nova-compute[74963]: WARNING nova.compute.manager [req-d84b9a1e-bc36-4ea0-9d79-5bbee7ce5a44 req-fe11cb13-d1df-4617-acc2-d8ceb48e0b88 service nova] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Received unexpected event network-vif-plugged-de0927d1-046c-4648-8a2d-12530f0eb550 for instance with vm_state active and task_state deleting.
Nov 30 08:34:54 user nova-compute[74963]: INFO nova.compute.manager [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Took 0.80 seconds to detach 1 volumes for instance.
Nov 30 08:34:54 user nova-compute[74963]: DEBUG nova.compute.manager [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9] Deleting volume: d9d87ad7-44cf-4f1b-9d06-2a6573404e88 {{(pid=74963) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:34:54 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:34:54 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Deleted allocations for instance 8c5ec5c2-7b07-4198-a410-aaa35e4d93c9
Nov 30 08:34:55 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-24a326c8-5843-4b35-9be4-064b2aae27bb tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "8c5ec5c2-7b07-4198-a410-aaa35e4d93c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.932s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:34:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-850fd419-280f-4663-8aa8-82f5f7006858 req-257f1eb9-e8ea-4282-935e-088a9ac0ecaf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-changed-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG nova.compute.manager [req-850fd419-280f-4663-8aa8-82f5f7006858 req-257f1eb9-e8ea-4282-935e-088a9ac0ecaf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Refreshing instance network info cache due to event network-changed-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-850fd419-280f-4663-8aa8-82f5f7006858 req-257f1eb9-e8ea-4282-935e-088a9ac0ecaf service nova] Acquiring lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-850fd419-280f-4663-8aa8-82f5f7006858 req-257f1eb9-e8ea-4282-935e-088a9ac0ecaf service nova] Acquired lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG nova.network.neutron [req-850fd419-280f-4663-8aa8-82f5f7006858 req-257f1eb9-e8ea-4282-935e-088a9ac0ecaf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Refreshing network info cache for port 7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG nova.objects.instance [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'flavor' on Instance uuid 8ee12860-9fdf-44cd-94fd-dee5f0941312 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:05 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Ignoring supplied device name: /dev/vdb
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:05 user nova-compute[74963]: INFO nova.compute.manager [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Attaching volume 626eafb7-b41b-4253-9857-b43d967efdb4 to /dev/vdb
Nov 30 08:35:05 user nova-compute[74963]: DEBUG nova.network.neutron [req-850fd419-280f-4663-8aa8-82f5f7006858 req-257f1eb9-e8ea-4282-935e-088a9ac0ecaf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Updated VIF entry in instance network info cache for port 7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG nova.network.neutron [req-850fd419-280f-4663-8aa8-82f5f7006858 req-257f1eb9-e8ea-4282-935e-088a9ac0ecaf service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Updating instance_info_cache with network_info: [{"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-850fd419-280f-4663-8aa8-82f5f7006858 req-257f1eb9-e8ea-4282-935e-088a9ac0ecaf service nova] Releasing lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG os_brick.utils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3903f3f-2b5f-4f63-9712-f10dca26b350]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda92dd5-c3d9-4dcb-9d44-732651d9f294]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b25714-4ff4-4dfe-a47b-96b81d8fa8a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b47c254-c207-4beb-bff9-a5609f0df50a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:35:05 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:35:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7727a08a-97f0-4852-8f6c-fd416f36f5b3]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG os_brick.utils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:05 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Updating existing volume attachment record: d72e38b3-911f-4f55-8332-fb5c1cdc3feb {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:06 user nova-compute[74963]: INFO nova.compute.manager [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Unshelving
Nov 30 08:35:06 user nova-compute[74963]: INFO nova.virt.block_device [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Booting with volume 24472034-ffa9-4aa5-9d7e-10c3dcb1e3de at /dev/vdc
Nov 30 08:35:06 user nova-compute[74963]: DEBUG os_brick.utils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba35128-3eb1-4707-bd51-cf6615003614]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e909bf17-846a-48aa-9dc5-3e735e933fca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa18ad-519a-4704-8167-b7893a7ece8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a515ffc-14a5-4196-9945-d148ba9e812a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:35:06 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:35:06 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3879d90b-ff91-4002-acfe-24c187e0ab15]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG os_brick.utils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:06 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updating existing volume attachment record: b1419de2-87ee-44a7-b05b-9fe1c273fa5b {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:35:07 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:35:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKkazqYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:13 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:13 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:13 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[57439a78-3345-4425-8fd5-b93960f5e18a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:35:13 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c996ceb-3170-43b0-9920-e923f9c339a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4] added
Nov 30 08:35:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b0db59-86aa-49f9-83fd-ec1494db0327]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfc8d36-c9f8-442b-8e9f-f4abeb34a6f2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DKkazqYU {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DKkazqYU" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[364bb6c3-124c-4d58-9782-69c2b6036658]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DKkazqYU'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8672cf89-3090-4fa0-843c-6d397c866538]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be90b29-fbec-4ec0-bf15-4da479619362]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 08:35:13 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 08:35:13 user nova-compute[74963]:  {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:13 user nova-compute[74963]: WARNING os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 08:35:13 user nova-compute[74963]: 
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86509f5-3e71-4949-a98a-2c558aa45d4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4, portal: 172.16.0.220,3260]
Nov 30 08:35:13 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4, portal: 172.16.0.220,3260] successful.
Nov 30 08:35:13 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad83f842-2ebe-4796-96bb-5ca47ef0efcb]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac859ee-e56f-4e1a-a233-4619f8b346fc]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ae0f2-37c4-4337-8e3b-c4dac853c895]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKkazqYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:35:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23337363262303434', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337363262303434', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'pci_requests' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.objects.instance [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'flavor' on Instance uuid 8ee12860-9fdf-44cd-94fd-dee5f0941312 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'numa_topology' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:35:15 user nova-compute[74963]: INFO nova.compute.claims [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Claim successful on node user
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:35:15 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:35:15 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:35:15 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:35:15 user nova-compute[74963]:   <serial>626eafb7-b41b-4253-9857-b43d967efdb4</serial>
Nov 30 08:35:15 user nova-compute[74963]: </disk>
Nov 30 08:35:15 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:15 user nova-compute[74963]: INFO nova.network.neutron [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updating port c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No VIF found with MAC fa:16:3e:0d:ff:4a, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-36c2b057-46b2-4e45-a236-b184a1b5e823 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.113s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquired lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:35:15 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-3469dc34-97f1-4294-a81a-0bb7d847f0ae req-2311342e-1457-44c9-9943-2c1e790c1682 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-changed-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-3469dc34-97f1-4294-a81a-0bb7d847f0ae req-2311342e-1457-44c9-9943-2c1e790c1682 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Refreshing instance network info cache due to event network-changed-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3469dc34-97f1-4294-a81a-0bb7d847f0ae req-2311342e-1457-44c9-9943-2c1e790c1682 service nova] Acquiring lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updating instance_info_cache with network_info: [{"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Releasing lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:35:16 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Creating image(s)
Nov 30 08:35:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'trusted_certs' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3469dc34-97f1-4294-a81a-0bb7d847f0ae req-2311342e-1457-44c9-9943-2c1e790c1682 service nova] Acquired lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG nova.network.neutron [req-3469dc34-97f1-4294-a81a-0bb7d847f0ae req-2311342e-1457-44c9-9943-2c1e790c1682 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Refreshing network info cache for port c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG nova.objects.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Object Instance<d5e59ea5-e429-426c-b89e-17aa7115ce84> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "41ebd8c42e8868d473c15b2948708eef7ad61c64" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "41ebd8c42e8868d473c15b2948708eef7ad61c64" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64.part --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:17 user nova-compute[74963]: DEBUG nova.virt.images [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] 63efb6a8-48ac-42d2-a8e7-141d9975b855 was qcow2, converting to raw {{(pid=74963) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 08:35:17 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:35:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64.part /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64.converted {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:17 user nova-compute[74963]: DEBUG nova.network.neutron [req-3469dc34-97f1-4294-a81a-0bb7d847f0ae req-2311342e-1457-44c9-9943-2c1e790c1682 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updated VIF entry in instance network info cache for port c36b3ac9-f1fb-4f70-8954-cc14592bf6c2. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:35:17 user nova-compute[74963]: DEBUG nova.network.neutron [req-3469dc34-97f1-4294-a81a-0bb7d847f0ae req-2311342e-1457-44c9-9943-2c1e790c1682 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updating instance_info_cache with network_info: [{"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:35:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:17 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-3469dc34-97f1-4294-a81a-0bb7d847f0ae req-2311342e-1457-44c9-9943-2c1e790c1682 service nova] Releasing lock "refresh_cache-d5e59ea5-e429-426c-b89e-17aa7115ce84" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64.part /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64.converted" returned: 0 in 0.696s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64.converted --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "41ebd8c42e8868d473c15b2948708eef7ad61c64" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.132s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64 --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "41ebd8c42e8868d473c15b2948708eef7ad61c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "41ebd8c42e8868d473c15b2948708eef7ad61c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64 --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64,backing_fmt=raw /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64,backing_fmt=raw /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk 1073741824" returned: 0 in 0.050s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "41ebd8c42e8868d473c15b2948708eef7ad61c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:18 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41ebd8c42e8868d473c15b2948708eef7ad61c64 --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'migration_context' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG nova.objects.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Object Instance<d5e59ea5-e429-426c-b89e-17aa7115ce84> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:35:19 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Rebasing disk image.
Nov 30 08:35:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 -F raw /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-bf93c943-d9be-4a61-a9c2-1ec818414bae req-238dc7a9-4176-4f9b-9cf4-9fa5f2a6d032 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received event network-changed-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG nova.compute.manager [req-bf93c943-d9be-4a61-a9c2-1ec818414bae req-238dc7a9-4176-4f9b-9cf4-9fa5f2a6d032 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Refreshing instance network info cache due to event network-changed-cd8de7e3-a358-48ab-9604-4b126ba45146. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bf93c943-d9be-4a61-a9c2-1ec818414bae req-238dc7a9-4176-4f9b-9cf4-9fa5f2a6d032 service nova] Acquiring lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bf93c943-d9be-4a61-a9c2-1ec818414bae req-238dc7a9-4176-4f9b-9cf4-9fa5f2a6d032 service nova] Acquired lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-bf93c943-d9be-4a61-a9c2-1ec818414bae req-238dc7a9-4176-4f9b-9cf4-9fa5f2a6d032 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Refreshing network info cache for port cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-bf93c943-d9be-4a61-a9c2-1ec818414bae req-238dc7a9-4176-4f9b-9cf4-9fa5f2a6d032 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Updated VIF entry in instance network info cache for port cd8de7e3-a358-48ab-9604-4b126ba45146. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG nova.network.neutron [req-bf93c943-d9be-4a61-a9c2-1ec818414bae req-238dc7a9-4176-4f9b-9cf4-9fa5f2a6d032 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Updating instance_info_cache with network_info: [{"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:35:19 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bf93c943-d9be-4a61-a9c2-1ec818414bae req-238dc7a9-4176-4f9b-9cf4-9fa5f2a6d032 service nova] Releasing lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 -F raw /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk" returned: 0 in 2.331s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Ensure instance console log exists: /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Start _get_guest_xml network_info=[{"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='7d738c477f4f0eb7ef41fc9ecc14f665',container_format='bare',created_at=2023-11-30T08:33:14Z,direct_url=<?>,disk_format='qcow2',id=63efb6a8-48ac-42d2-a8e7-141d9975b855,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1988636161-shelved',owner='36c9009714354721a7697c14258ffc7d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T08:33:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRTKjESi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd5e59ea5-e429-426c-b89e-17aa7115ce84', 'attached_at': '', 'detached_at': '', 'volume_id': '24472034-ffa9-4aa5-9d7e-10c3dcb1e3de', 'serial': '24472034-ffa9-4aa5-9d7e-10c3dcb1e3de'}, 'attachment_id': 'b1419de2-87ee-44a7-b05b-9fe1c273fa5b', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:35:21 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:35:21 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7d738c477f4f0eb7ef41fc9ecc14f665',container_format='bare',created_at=2023-11-30T08:33:14Z,direct_url=<?>,disk_format='qcow2',id=63efb6a8-48ac-42d2-a8e7-141d9975b855,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1988636161-shelved',owner='36c9009714354721a7697c14258ffc7d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T08:33:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.objects.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Object Instance<d5e59ea5-e429-426c-b89e-17aa7115ce84> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRTKjESi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:21 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:21 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.026s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:21 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:35:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260" returned: 21 in 0.048s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[03048a37-a9d3-4460-b99d-23852e9930a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:21 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:35:21 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf429a5-5331-4165-baef-331087c4b93b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de] added
Nov 30 08:35:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.097s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5947271-2163-46ae-978b-0e9c63356efb]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.091s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5691c0-71ad-42ed-94ce-ff33eb79cd2a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRTKjESi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRTKjESi" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b962213-9f8d-496a-b2da-22c2198fda44]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vRTKjESi'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[011f3de6-f7a9-438b-b8f4-231a00a562fd]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a138957c-ef9c-4857-82c6-964be211a157]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f99f83d-307e-4b7b-9fff-3ce415c77745]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de, portal: 172.16.0.220,3260]
Nov 30 08:35:22 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de, portal: 172.16.0.220,3260] successful.
Nov 30 08:35:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b10f5a5-e882-411b-9d98-e84e48c1693b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1399faef-42fd-4131-88c9-593b9b47c042]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:22 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:22 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.462s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a7bdb3-ad49-4ff5-be1a-3088145657ec]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRTKjESi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Updating instance_info_cache with network_info: [{"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-8ee12860-9fdf-44cd-94fd-dee5f0941312" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.objects.instance [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'flavor' on Instance uuid 89a37a46-76ec-4166-bb1d-c4b50a544bc9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.522s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '23365643266663531', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365643266663531', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:23 user nova-compute[74963]: INFO nova.compute.manager [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Attaching volume 1eb5de72-f0b2-4b83-b03e-a7d5b557f367 to /dev/vdb
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T08:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1988636161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1988636161',id=37,image_ref='63efb6a8-48ac-42d2-a8e7-141d9975b855',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1641280519',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:31:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='36c9009714354721a7697c14258ffc7d',ramdisk_id='',reservation_id='r-lytpxy1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1943160204',owner_user_name='tempest-AttachVolumeShelveTestJSON-1943160204-project-member',shelved_at='2023-11-30T08:33:20.217700',shelved_host='user',shelved_image_id='63efb6a8-48ac-42d2-a8e7-141d9975b855'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad49a6fbce944b719e6f09a5e2bd1b30',uuid=d5e59ea5-e429-426c-b89e-17aa7115ce84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converting VIF {"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'pci_devices' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.objects.base [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Object Instance<d5e59ea5-e429-426c-b89e-17aa7115ce84> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:35:23 user nova-compute[74963]:   <uuid>d5e59ea5-e429-426c-b89e-17aa7115ce84</uuid>
Nov 30 08:35:23 user nova-compute[74963]:   <name>instance-00000025</name>
Nov 30 08:35:23 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:35:23 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:35:23 user nova-compute[74963]:   <metadata>
Nov 30 08:35:23 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:35:23 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:35:23 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1988636161</nova:name>
Nov 30 08:35:23 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:35:21</nova:creationTime>
Nov 30 08:35:23 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:35:23 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:35:23 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:35:23 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:35:23 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:35:23 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:35:23 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:35:23 user nova-compute[74963]:       <nova:owner>
Nov 30 08:35:23 user nova-compute[74963]:         <nova:user uuid="ad49a6fbce944b719e6f09a5e2bd1b30">tempest-AttachVolumeShelveTestJSON-1943160204-project-member</nova:user>
Nov 30 08:35:23 user nova-compute[74963]:         <nova:project uuid="36c9009714354721a7697c14258ffc7d">tempest-AttachVolumeShelveTestJSON-1943160204</nova:project>
Nov 30 08:35:23 user nova-compute[74963]:       </nova:owner>
Nov 30 08:35:23 user nova-compute[74963]:       <nova:root type="image" uuid="63efb6a8-48ac-42d2-a8e7-141d9975b855"/>
Nov 30 08:35:23 user nova-compute[74963]:       <nova:ports>
Nov 30 08:35:23 user nova-compute[74963]:         <nova:port uuid="c36b3ac9-f1fb-4f70-8954-cc14592bf6c2">
Nov 30 08:35:23 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 08:35:23 user nova-compute[74963]:         </nova:port>
Nov 30 08:35:23 user nova-compute[74963]:       </nova:ports>
Nov 30 08:35:23 user nova-compute[74963]:     </nova:instance>
Nov 30 08:35:23 user nova-compute[74963]:   </metadata>
Nov 30 08:35:23 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:35:23 user nova-compute[74963]:     <system>
Nov 30 08:35:23 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:35:23 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:35:23 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:35:23 user nova-compute[74963]:       <entry name="serial">d5e59ea5-e429-426c-b89e-17aa7115ce84</entry>
Nov 30 08:35:23 user nova-compute[74963]:       <entry name="uuid">d5e59ea5-e429-426c-b89e-17aa7115ce84</entry>
Nov 30 08:35:23 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:35:23 user nova-compute[74963]:     </system>
Nov 30 08:35:23 user nova-compute[74963]:   </sysinfo>
Nov 30 08:35:23 user nova-compute[74963]:   <os>
Nov 30 08:35:23 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:35:23 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:35:23 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:35:23 user nova-compute[74963]:   </os>
Nov 30 08:35:23 user nova-compute[74963]:   <features>
Nov 30 08:35:23 user nova-compute[74963]:     <acpi/>
Nov 30 08:35:23 user nova-compute[74963]:     <apic/>
Nov 30 08:35:23 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:35:23 user nova-compute[74963]:   </features>
Nov 30 08:35:23 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:35:23 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:35:23 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:35:23 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:35:23 user nova-compute[74963]:   </clock>
Nov 30 08:35:23 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:35:23 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:35:23 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:35:23 user nova-compute[74963]:   </cpu>
Nov 30 08:35:23 user nova-compute[74963]:   <devices>
Nov 30 08:35:23 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:35:23 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:35:23 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk"/>
Nov 30 08:35:23 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:35:23 user nova-compute[74963]:     </disk>
Nov 30 08:35:23 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:35:23 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:35:23 user nova-compute[74963]:       <source dev="/dev/sdc"/>
Nov 30 08:35:23 user nova-compute[74963]:       <target dev="vdc" bus="virtio"/>
Nov 30 08:35:23 user nova-compute[74963]:       <serial>24472034-ffa9-4aa5-9d7e-10c3dcb1e3de</serial>
Nov 30 08:35:23 user nova-compute[74963]:     </disk>
Nov 30 08:35:23 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:35:23 user nova-compute[74963]:       <mac address="fa:16:3e:07:c6:af"/>
Nov 30 08:35:23 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:35:23 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:35:23 user nova-compute[74963]:       <target dev="tapc36b3ac9-f1"/>
Nov 30 08:35:23 user nova-compute[74963]:     </interface>
Nov 30 08:35:23 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:35:23 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/console.log" append="off"/>
Nov 30 08:35:23 user nova-compute[74963]:     </serial>
Nov 30 08:35:23 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:35:23 user nova-compute[74963]:     <video>
Nov 30 08:35:23 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:35:23 user nova-compute[74963]:     </video>
Nov 30 08:35:23 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:35:23 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:35:23 user nova-compute[74963]:     </rng>
Nov 30 08:35:23 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:35:23 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:35:23 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:35:23 user nova-compute[74963]:     </memballoon>
Nov 30 08:35:23 user nova-compute[74963]:   </devices>
Nov 30 08:35:23 user nova-compute[74963]: </domain>
Nov 30 08:35:23 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T08:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1988636161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1988636161',id=37,image_ref='63efb6a8-48ac-42d2-a8e7-141d9975b855',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1641280519',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:31:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='36c9009714354721a7697c14258ffc7d',ramdisk_id='',reservation_id='r-lytpxy1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1943160204',owner_user_name='tempest-AttachVolumeShelveTestJSON-1943160204-project-member',shelved_at='2023-11-30T08:33:20.217700',shelved_host='user',shelved_image_id='63efb6a8-48ac-42d2-a8e7-141d9975b855'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad49a6fbce944b719e6f09a5e2bd1b30',uuid=d5e59ea5-e429-426c-b89e-17aa7115ce84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converting VIF {"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG os_vif [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '219c836c-b1a2-5c1c-ba4a-1e5702b03d7d', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc36b3ac9-f1, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc36b3ac9-f1, col_values=(('qos', UUID('12d0937c-f515-4736-854e-fbd4b171d73b')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc36b3ac9-f1, col_values=(('external_ids', {'iface-id': 'c36b3ac9-f1fb-4f70-8954-cc14592bf6c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:c6:af', 'vm-uuid': 'd5e59ea5-e429-426c-b89e-17aa7115ce84'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG os_brick.utils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:23 user nova-compute[74963]: INFO os_vif [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1')
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fa741b-2934-4cf8-82c4-dabbd81397e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed1ff65-51b9-470d-b262-86324d02d427]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] No VIF found with MAC fa:16:3e:07:c6:af, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.038s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31144a3-1793-480b-9e2c-b1690fc0a2d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c7d9ec-2875-4d60-a800-1a4d95b52da4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:35:23 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3557b3-150c-4ca8-b0e7-19f3f205fd20]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG os_brick.utils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] <== get_connector_properties: return (262ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Updating existing volume attachment record: f557b9a6-83d3-4429-892f-a1732afe4602 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:35:24 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:35:24 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8605MB free_disk=25.026138305664062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 8ee12860-9fdf-44cd-94fd-dee5f0941312 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (41961ac9-576a-4a02-a5e7-459f54657b3f): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:35:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-fc62fda5-3257-400e-b995-60456aee8aab req-2b2811cb-ab46-4fbd-95f0-486de0a996ff service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fc62fda5-3257-400e-b995-60456aee8aab req-2b2811cb-ab46-4fbd-95f0-486de0a996ff service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fc62fda5-3257-400e-b995-60456aee8aab req-2b2811cb-ab46-4fbd-95f0-486de0a996ff service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fc62fda5-3257-400e-b995-60456aee8aab req-2b2811cb-ab46-4fbd-95f0-486de0a996ff service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG nova.compute.manager [req-fc62fda5-3257-400e-b995-60456aee8aab req-2b2811cb-ab46-4fbd-95f0-486de0a996ff service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:35:25 user nova-compute[74963]: WARNING nova.compute.manager [req-fc62fda5-3257-400e-b995-60456aee8aab req-2b2811cb-ab46-4fbd-95f0-486de0a996ff service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 08:35:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:35:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:35:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:35:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:35:27 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:35:27 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:35:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:35:27 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance spawned successfully.
Nov 30 08:35:27 user nova-compute[74963]: DEBUG nova.compute.manager [req-f9844cd1-d0f5-4e9c-aed5-4a06df0c5470 req-f73b16f7-b1b1-4ca8-8591-8c8805e9bdc1 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:35:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f9844cd1-d0f5-4e9c-aed5-4a06df0c5470 req-f73b16f7-b1b1-4ca8-8591-8c8805e9bdc1 service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f9844cd1-d0f5-4e9c-aed5-4a06df0c5470 req-f73b16f7-b1b1-4ca8-8591-8c8805e9bdc1 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f9844cd1-d0f5-4e9c-aed5-4a06df0c5470 req-f73b16f7-b1b1-4ca8-8591-8c8805e9bdc1 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:27 user nova-compute[74963]: DEBUG nova.compute.manager [req-f9844cd1-d0f5-4e9c-aed5-4a06df0c5470 req-f73b16f7-b1b1-4ca8-8591-8c8805e9bdc1 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:35:27 user nova-compute[74963]: WARNING nova.compute.manager [req-f9844cd1-d0f5-4e9c-aed5-4a06df0c5470 req-f73b16f7-b1b1-4ca8-8591-8c8805e9bdc1 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 08:35:27 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:35:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0177b95-3171-45c8-9a38-9709c73ce4ef tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.966s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'flavor' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:30 user nova-compute[74963]: INFO nova.compute.manager [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Attaching volume 56fcb203-36bb-4b89-a125-2d4e596bbf14 to /dev/vdb
Nov 30 08:35:30 user nova-compute[74963]: DEBUG os_brick.utils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec2134-ac22-478f-b49e-521445e788cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc40ad4-138f-4097-926e-f100f5fcd2f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9905fe03-d00b-42b0-91a4-22508b26170d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c15812-f8cf-4523-a601-b2a8d843e28b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:35:30 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:35:30 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[31435190-1be8-47e1-b446-877a6f6542da]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG os_brick.utils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:30 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating existing volume attachment record: 293726a5-b770-4843-a618-9733290240a8 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJTfEvrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:33 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:33 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:33 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69113b4a-0258-4e9c-8e1d-bdd04190076f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:35:33 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[798c983b-e703-45af-b960-642b2f8ec5c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367] added
Nov 30 08:35:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc358bd-2143-4840-a00d-1899053a5054]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[af897f50-3060-439a-884e-5db44fce7d62]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJTfEvrk {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJTfEvrk" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ec529-9a9b-45ec-a71e-294ba42edb62]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJTfEvrk'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d72fee-fcd6-4124-ae73-49083f2fe5ad]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f555b-7634-48fa-98d2-3e50dc127f5c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:33 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:33 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fefc04-9755-4846-9b52-3d836f4cbd83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367, portal: 172.16.0.220,3260]
Nov 30 08:35:33 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367, portal: 172.16.0.220,3260] successful.
Nov 30 08:35:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdc9d49-4412-420d-aff2-4dc727e20e4b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7af2b97-f858-4560-8402-6704e7d708f8]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:33 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:33 user nova-compute[74963]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)
Nov 30 08:35:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:33 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:33 user nova-compute[74963]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)
Nov 30 08:35:33 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c621d1ca-c39f-434d-9ae9-d07fd102b141]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJTfEvrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:35:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:34 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26238653566623433', 'path': '/dev/sdd'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238653566623433', 'path': '/dev/sdd'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:35:34 user nova-compute[74963]: DEBUG nova.objects.instance [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'flavor' on Instance uuid 89a37a46-76ec-4166-bb1d-c4b50a544bc9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:34 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:35:34 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:35:34 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:35:34 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:35:34 user nova-compute[74963]:   <serial>1eb5de72-f0b2-4b83-b03e-a7d5b557f367</serial>
Nov 30 08:35:34 user nova-compute[74963]: </disk>
Nov 30 08:35:34 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:35:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:35:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:35:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No VIF found with MAC fa:16:3e:5a:d4:45, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:35:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-56a8fae3-630c-4558-909d-3f2f7048834f tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.764s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:35 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:35 user nova-compute[74963]: INFO nova.compute.manager [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Detaching volume 1eb5de72-f0b2-4b83-b03e-a7d5b557f367
Nov 30 08:35:35 user nova-compute[74963]: INFO nova.virt.block_device [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Attempting to driver detach volume 1eb5de72-f0b2-4b83-b03e-a7d5b557f367 from mountpoint /dev/vdb
Nov 30 08:35:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Attempting to detach device vdb from instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:35:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:35:35 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:35:35 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:35:35 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:35:35 user nova-compute[74963]:   <serial>1eb5de72-f0b2-4b83-b03e-a7d5b557f367</serial>
Nov 30 08:35:35 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:35:35 user nova-compute[74963]: </disk>
Nov 30 08:35:35 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:35:35 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully detached device vdb from instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9 from the persistent domain config.
Nov 30 08:35:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:35:35 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:35:35 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:35:35 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:35:35 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:35:35 user nova-compute[74963]:   <serial>1eb5de72-f0b2-4b83-b03e-a7d5b557f367</serial>
Nov 30 08:35:35 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:35:35 user nova-compute[74963]: </disk>
Nov 30 08:35:35 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:35:36 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:35:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJUHQvkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:40 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:40 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:40 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98c5712-0cbf-4a84-9a92-a9d6fa1ec9f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:35:40 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a25cbf-bbda-4d10-909a-a4ded5b2897b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14] added
Nov 30 08:35:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b25a70-ec4b-40a8-a46b-bfdec3cd904a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dbbbfc-55b1-46c9-893e-eb6794a4f6d2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJUHQvkt {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJUHQvkt" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa25b48-d911-4e0e-aecb-b86256b703c7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJUHQvkt'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39ab8c-68f3-4956-b45d-4ca9c257e8c7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c575a311-396f-45c8-b7b6-e45421897078]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d56daa-1e58-404f-9a5d-b0ae5cbf634c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260]
Nov 30 08:35:40 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260] successful.
Nov 30 08:35:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcc0eb7-56ad-4b84-8fd8-7f742f4ee75e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[484b17f9-d5ab-4970-96e5-aa8f27f7c7ab]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:35:40 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a57e383-80c5-4c15-bcc0-11b576643f2f]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:35:40 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJUHQvkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:35:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:41 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23039663466656435', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039663466656435', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:35:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'flavor' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:35:41 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:35:41 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:35:41 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:35:41 user nova-compute[74963]:   <serial>56fcb203-36bb-4b89-a125-2d4e596bbf14</serial>
Nov 30 08:35:41 user nova-compute[74963]: </disk>
Nov 30 08:35:41 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:35:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:35:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:35:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] No VIF found with MAC fa:16:3e:27:b5:61, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:35:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f22e0164-b053-4cea-a6f7-53e79c7b7480 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.460s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:42 user nova-compute[74963]: INFO nova.compute.manager [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Detaching volume 626eafb7-b41b-4253-9857-b43d967efdb4
Nov 30 08:35:42 user nova-compute[74963]: INFO nova.virt.block_device [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Attempting to driver detach volume 626eafb7-b41b-4253-9857-b43d967efdb4 from mountpoint /dev/vdb
Nov 30 08:35:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Attempting to detach device vdb from instance 8ee12860-9fdf-44cd-94fd-dee5f0941312 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:35:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:35:42 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:35:42 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:35:42 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:35:42 user nova-compute[74963]:   <serial>626eafb7-b41b-4253-9857-b43d967efdb4</serial>
Nov 30 08:35:42 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:35:42 user nova-compute[74963]: </disk>
Nov 30 08:35:42 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:35:42 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Successfully detached device vdb from instance 8ee12860-9fdf-44cd-94fd-dee5f0941312 from the persistent domain config.
Nov 30 08:35:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ee12860-9fdf-44cd-94fd-dee5f0941312 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:35:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:35:42 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:35:42 user nova-compute[74963]:   <source dev="/dev/sdb"/>
Nov 30 08:35:42 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:35:42 user nova-compute[74963]:   <serial>626eafb7-b41b-4253-9857-b43d967efdb4</serial>
Nov 30 08:35:42 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:35:42 user nova-compute[74963]: </disk>
Nov 30 08:35:42 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:35:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ee12860-9fdf-44cd-94fd-dee5f0941312 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:35:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-41bf8973-ca6f-4b62-b480-0dae990b208f req-873b753f-970f-4bae-a348-0c13eebb1234 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:35:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-41bf8973-ca6f-4b62-b480-0dae990b208f req-873b753f-970f-4bae-a348-0c13eebb1234 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing instance network info cache due to event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:35:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41bf8973-ca6f-4b62-b480-0dae990b208f req-873b753f-970f-4bae-a348-0c13eebb1234 service nova] Acquiring lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:35:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41bf8973-ca6f-4b62-b480-0dae990b208f req-873b753f-970f-4bae-a348-0c13eebb1234 service nova] Acquired lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:35:48 user nova-compute[74963]: DEBUG nova.network.neutron [req-41bf8973-ca6f-4b62-b480-0dae990b208f req-873b753f-970f-4bae-a348-0c13eebb1234 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:35:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:49 user nova-compute[74963]: DEBUG nova.network.neutron [req-41bf8973-ca6f-4b62-b480-0dae990b208f req-873b753f-970f-4bae-a348-0c13eebb1234 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updated VIF entry in instance network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:35:49 user nova-compute[74963]: DEBUG nova.network.neutron [req-41bf8973-ca6f-4b62-b480-0dae990b208f req-873b753f-970f-4bae-a348-0c13eebb1234 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:35:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-41bf8973-ca6f-4b62-b480-0dae990b208f req-873b753f-970f-4bae-a348-0c13eebb1234 service nova] Releasing lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:35:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-29c53f7f-297f-4d57-9edc-7aa725e1b052 req-d1339bc9-1b2a-4a74-8a93-d07c69254dae service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:35:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-29c53f7f-297f-4d57-9edc-7aa725e1b052 req-d1339bc9-1b2a-4a74-8a93-d07c69254dae service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing instance network info cache due to event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:35:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-29c53f7f-297f-4d57-9edc-7aa725e1b052 req-d1339bc9-1b2a-4a74-8a93-d07c69254dae service nova] Acquiring lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:35:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-29c53f7f-297f-4d57-9edc-7aa725e1b052 req-d1339bc9-1b2a-4a74-8a93-d07c69254dae service nova] Acquired lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:35:50 user nova-compute[74963]: DEBUG nova.network.neutron [req-29c53f7f-297f-4d57-9edc-7aa725e1b052 req-d1339bc9-1b2a-4a74-8a93-d07c69254dae service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:35:51 user nova-compute[74963]: DEBUG nova.network.neutron [req-29c53f7f-297f-4d57-9edc-7aa725e1b052 req-d1339bc9-1b2a-4a74-8a93-d07c69254dae service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updated VIF entry in instance network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:35:51 user nova-compute[74963]: DEBUG nova.network.neutron [req-29c53f7f-297f-4d57-9edc-7aa725e1b052 req-d1339bc9-1b2a-4a74-8a93-d07c69254dae service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:35:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-29c53f7f-297f-4d57-9edc-7aa725e1b052 req-d1339bc9-1b2a-4a74-8a93-d07c69254dae service nova] Releasing lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:35:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:56 user nova-compute[74963]: INFO nova.compute.manager [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Rebooting instance
Nov 30 08:35:56 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9 is timed out.
Nov 30 08:35:56 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully detached device vdb from instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9 from the live domain config.
Nov 30 08:35:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJTfEvrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:56 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e77cd3-009d-464a-ac09-65d583b0ee4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:35:56 user nova-compute[74963]: No targets found.
Nov 30 08:35:56 user nova-compute[74963]: iSNS:
Nov 30 08:35:56 user nova-compute[74963]: No targets found.
Nov 30 08:35:56 user nova-compute[74963]: STATIC:
Nov 30 08:35:56 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4
Nov 30 08:35:56 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:35:56 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:35:56 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de
Nov 30 08:35:56 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:35:56 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:35:56 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14
Nov 30 08:35:56 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:35:56 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:35:56 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367
Nov 30 08:35:56 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:35:56 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:35:56 user nova-compute[74963]: FIRMWARE:
Nov 30 08:35:56 user nova-compute[74963]: No targets found.
Nov 30 08:35:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:35:56 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:35:56 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d061f900-641b-4f8d-ab3f-96a7484ddfc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquired lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG nova.network.neutron [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec6a32b-f501-42f7-bb36-c8d64cdb27e8]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:56 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:56 user nova-compute[74963]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)
Nov 30 08:35:56 user nova-compute[74963]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:35:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:56 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:56 user nova-compute[74963]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 (non-flash)
Nov 30 08:35:56 user nova-compute[74963]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:35:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62205d0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367'): ({'sdd'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Removing single pathed devices sdd {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e8cfb3-79a3-4cfd-8b17-852e124b6ab8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f69d049-7916-4ccc-8c8b-84e6575a8b6f]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flushing IO for device /dev/sdd {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cb7d4a-4071-46a4-b84a-43bfdb869f94]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef8334c-778b-424e-bf44-8bdcfcd9f187]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f0fcce-4512-4c9a-8ca3-dae68507f2bd]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[09742bb9-ee95-4021-86bb-08f80dd42996]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367, portal: 172.16.0.220,3260]
Nov 30 08:35:56 user nova-compute[74963]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367, portal: 172.16.0.220,3260] successful.
Nov 30 08:35:56 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb5de72-f0b2-4b83-b03e-a7d5b557f367 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf791ade-7738-4ad4-9234-f45d6d45cd8f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] <== disconnect_volume: return (333ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG nova.network.neutron [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Releasing lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG nova.objects.instance [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'flavor' on Instance uuid 89a37a46-76ec-4166-bb1d-c4b50a544bc9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-43a1560c-b0ef-4c87-99c0-0249bf0e7a03 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-ca67af96-a4c7-412f-b86b-8a5d863acd5f req-301d0ec9-b37c-448a-afad-f58aa3cf42d5 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-unplugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ca67af96-a4c7-412f-b86b-8a5d863acd5f req-301d0ec9-b37c-448a-afad-f58aa3cf42d5 service nova] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ca67af96-a4c7-412f-b86b-8a5d863acd5f req-301d0ec9-b37c-448a-afad-f58aa3cf42d5 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ca67af96-a4c7-412f-b86b-8a5d863acd5f req-301d0ec9-b37c-448a-afad-f58aa3cf42d5 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:57 user nova-compute[74963]: DEBUG nova.compute.manager [req-ca67af96-a4c7-412f-b86b-8a5d863acd5f req-301d0ec9-b37c-448a-afad-f58aa3cf42d5 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] No waiting events found dispatching network-vif-unplugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:35:57 user nova-compute[74963]: WARNING nova.compute.manager [req-ca67af96-a4c7-412f-b86b-8a5d863acd5f req-301d0ec9-b37c-448a-afad-f58aa3cf42d5 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received unexpected event network-vif-unplugged-d971edba-1059-4e1c-a701-aee51ab5cd59 for instance with vm_state active and task_state reboot_started_hard.
Nov 30 08:35:58 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Instance destroyed successfully.
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.objects.instance [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'resources' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-350375214',display_name='tempest-TestMinimumBasicScenario-server-350375214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-350375214',id=41,image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNTMdTZqGdn5fGGpuwmipL8JAwunkj6tNUcOg3KCk39VwIlTZ5bPaPdjgX29N8YB3Kn8ib9NsNjsSE3qN3tlCeA2Alp233wU5LJH2Ce5RAQobujjVxxwOiWHItwL02og==',key_name='tempest-TestMinimumBasicScenario-1406737130',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:33:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a4df22008114c12b02eff15a5b3c228',ramdisk_id='',reservation_id='r-jj18c6oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-171021974',owner_user_name='tempest-TestMinimumBasicScenario-171021974-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:35:57Z,user_data=None,user_id='c6ad4469500b4c01a5ddf6bf2208e955',uuid=852f07b2-063c-4225-ba5d-2aa8fd25ea5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converting VIF {"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_vif [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd971edba-10, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=576a77fc-319f-44f5-8013-63db680998d1) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:35:58 user nova-compute[74963]: INFO os_vif [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10')
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJUHQvkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:58 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa97cc9-09a1-49a0-9cee-55b85721fb15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:35:58 user nova-compute[74963]: No targets found.
Nov 30 08:35:58 user nova-compute[74963]: iSNS:
Nov 30 08:35:58 user nova-compute[74963]: No targets found.
Nov 30 08:35:58 user nova-compute[74963]: STATIC:
Nov 30 08:35:58 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4
Nov 30 08:35:58 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:35:58 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:35:58 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de
Nov 30 08:35:58 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:35:58 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:35:58 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14
Nov 30 08:35:58 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:35:58 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:35:58 user nova-compute[74963]: FIRMWARE:
Nov 30 08:35:58 user nova-compute[74963]: No targets found.
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:35:58 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:35:58 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[db244fb6-94e5-4f77-8b15-40bbd5ff3f4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83034ab-e3a3-4d1a-9c37-2c97b07e2281]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62446b13f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14'): ({'sde'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Removing single pathed devices sde {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8920f634-b79d-445a-9d0d-1ea2cf48e2a0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec6f5b1-0fc2-489d-b299-3b6b4497f651]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Flushing IO for device /dev/sde {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f76cf5-2909-4afa-b99c-c2f651ebdf1c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c60f017-1668-4292-b619-f343450e43bc]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f500107-422b-40ef-9b75-330fa6bfcb60]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f9a2e9-2468-49e1-bbb2-9f5d72fac770]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260]
Nov 30 08:35:58 user nova-compute[74963]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260] successful.
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fd5e42-658b-4f95-8f0a-10288cc0f0c1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] <== disconnect_volume: return (336ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Start _get_guest_xml network_info=[{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=438ac9a9-7c77-4030-b963-c9bb079ae8fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': '438ac9a9-7c77-4030-b963-c9bb079ae8fa'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJUHQvkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '852f07b2-063c-4225-ba5d-2aa8fd25ea5c', 'attached_at': '', 'detached_at': '', 'volume_id': '56fcb203-36bb-4b89-a125-2d4e596bbf14', 'serial': '56fcb203-36bb-4b89-a125-2d4e596bbf14'}, 'attachment_id': '293726a5-b770-4843-a618-9733290240a8', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:35:58 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:35:58 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=438ac9a9-7c77-4030-b963-c9bb079ae8fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.objects.instance [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'vcpu_model' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.objects.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Object Instance<852f07b2-063c-4225-ba5d-2aa8fd25ea5c> lazy-loaded attributes: resources,vcpu_model {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJUHQvkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:35:58 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:58 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:35:58 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6a623c-71ce-4cde-8c72-09501ee05a15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:35:58 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71c5d4a-01c1-4ca6-a4f2-1851fd95231a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14] added
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4f6429-65f3-4ef3-8a2f-1382e125de2e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d9b890-5b49-4367-86d9-7d125897df5f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJUHQvkt {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJUHQvkt" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d557599-7259-40a3-9e15-4df468cad4b3]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJUHQvkt'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1330a14f-0bf6-4edb-b8b6-aefa9c58449c]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8864e540-1f1e-4bde-91a5-de82bc5552ae]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfdd5e4-93a7-4b26-8d25-84a1a7fcffd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260]
Nov 30 08:35:58 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260] successful.
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f3dabf-3ca9-43b0-99e5-f624f861764f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5474c3d5-0c65-44f6-ac6d-9a56e6f1ad5e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:35:58 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:35:58 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57fbd96-3f26-44d8-8137-ab51a47e23e8]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:35:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJUHQvkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:35:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-eca9c483-84cc-4bb0-bf00-53e18961d8e5 req-d5989608-0376-4d23-8bc4-b6b0a6fcee58 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:35:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-eca9c483-84cc-4bb0-bf00-53e18961d8e5 req-d5989608-0376-4d23-8bc4-b6b0a6fcee58 service nova] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:35:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-eca9c483-84cc-4bb0-bf00-53e18961d8e5 req-d5989608-0376-4d23-8bc4-b6b0a6fcee58 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:35:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-eca9c483-84cc-4bb0-bf00-53e18961d8e5 req-d5989608-0376-4d23-8bc4-b6b0a6fcee58 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:35:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-eca9c483-84cc-4bb0-bf00-53e18961d8e5 req-d5989608-0376-4d23-8bc4-b6b0a6fcee58 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] No waiting events found dispatching network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:35:59 user nova-compute[74963]: WARNING nova.compute.manager [req-eca9c483-84cc-4bb0-bf00-53e18961d8e5 req-d5989608-0376-4d23-8bc4-b6b0a6fcee58 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received unexpected event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 for instance with vm_state active and task_state reboot_started_hard.
Nov 30 08:35:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:35:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:35:59 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23039663466656435', 'path': '/dev/sdd'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:35:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039663466656435', 'path': '/dev/sdd'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-350375214',display_name='tempest-TestMinimumBasicScenario-server-350375214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-350375214',id=41,image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNTMdTZqGdn5fGGpuwmipL8JAwunkj6tNUcOg3KCk39VwIlTZ5bPaPdjgX29N8YB3Kn8ib9NsNjsSE3qN3tlCeA2Alp233wU5LJH2Ce5RAQobujjVxxwOiWHItwL02og==',key_name='tempest-TestMinimumBasicScenario-1406737130',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:33:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a4df22008114c12b02eff15a5b3c228',ramdisk_id='',reservation_id='r-jj18c6oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-171021974',owner_user_name='tempest-TestMinimumBasicScenario-171021974-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:35:57Z,user_data=None,user_id='c6ad4469500b4c01a5ddf6bf2208e955',uuid=852f07b2-063c-4225-ba5d-2aa8fd25ea5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converting VIF {"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'pci_devices' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "1823711f-c16f-4200-a689-994e79c330a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "1823711f-c16f-4200-a689-994e79c330a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.objects.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Object Instance<852f07b2-063c-4225-ba5d-2aa8fd25ea5c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:36:00 user nova-compute[74963]:   <uuid>852f07b2-063c-4225-ba5d-2aa8fd25ea5c</uuid>
Nov 30 08:36:00 user nova-compute[74963]:   <name>instance-00000029</name>
Nov 30 08:36:00 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:36:00 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:36:00 user nova-compute[74963]:   <metadata>
Nov 30 08:36:00 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:36:00 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:36:00 user nova-compute[74963]:       <nova:name>tempest-TestMinimumBasicScenario-server-350375214</nova:name>
Nov 30 08:36:00 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:35:58</nova:creationTime>
Nov 30 08:36:00 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:36:00 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:36:00 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:36:00 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:36:00 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:36:00 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:36:00 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:36:00 user nova-compute[74963]:       <nova:owner>
Nov 30 08:36:00 user nova-compute[74963]:         <nova:user uuid="c6ad4469500b4c01a5ddf6bf2208e955">tempest-TestMinimumBasicScenario-171021974-project-member</nova:user>
Nov 30 08:36:00 user nova-compute[74963]:         <nova:project uuid="3a4df22008114c12b02eff15a5b3c228">tempest-TestMinimumBasicScenario-171021974</nova:project>
Nov 30 08:36:00 user nova-compute[74963]:       </nova:owner>
Nov 30 08:36:00 user nova-compute[74963]:       <nova:root type="image" uuid="438ac9a9-7c77-4030-b963-c9bb079ae8fa"/>
Nov 30 08:36:00 user nova-compute[74963]:       <nova:ports>
Nov 30 08:36:00 user nova-compute[74963]:         <nova:port uuid="d971edba-1059-4e1c-a701-aee51ab5cd59">
Nov 30 08:36:00 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 08:36:00 user nova-compute[74963]:         </nova:port>
Nov 30 08:36:00 user nova-compute[74963]:       </nova:ports>
Nov 30 08:36:00 user nova-compute[74963]:     </nova:instance>
Nov 30 08:36:00 user nova-compute[74963]:   </metadata>
Nov 30 08:36:00 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:36:00 user nova-compute[74963]:     <system>
Nov 30 08:36:00 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:36:00 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:36:00 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:36:00 user nova-compute[74963]:       <entry name="serial">852f07b2-063c-4225-ba5d-2aa8fd25ea5c</entry>
Nov 30 08:36:00 user nova-compute[74963]:       <entry name="uuid">852f07b2-063c-4225-ba5d-2aa8fd25ea5c</entry>
Nov 30 08:36:00 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:36:00 user nova-compute[74963]:     </system>
Nov 30 08:36:00 user nova-compute[74963]:   </sysinfo>
Nov 30 08:36:00 user nova-compute[74963]:   <os>
Nov 30 08:36:00 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:36:00 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:36:00 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:36:00 user nova-compute[74963]:   </os>
Nov 30 08:36:00 user nova-compute[74963]:   <features>
Nov 30 08:36:00 user nova-compute[74963]:     <acpi/>
Nov 30 08:36:00 user nova-compute[74963]:     <apic/>
Nov 30 08:36:00 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:36:00 user nova-compute[74963]:   </features>
Nov 30 08:36:00 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:36:00 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:36:00 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:36:00 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:36:00 user nova-compute[74963]:   </clock>
Nov 30 08:36:00 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:36:00 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:36:00 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:36:00 user nova-compute[74963]:   </cpu>
Nov 30 08:36:00 user nova-compute[74963]:   <devices>
Nov 30 08:36:00 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:36:00 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:36:00 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk"/>
Nov 30 08:36:00 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:36:00 user nova-compute[74963]:     </disk>
Nov 30 08:36:00 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:36:00 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:36:00 user nova-compute[74963]:       <source dev="/dev/sdd"/>
Nov 30 08:36:00 user nova-compute[74963]:       <target dev="vdb" bus="virtio"/>
Nov 30 08:36:00 user nova-compute[74963]:       <serial>56fcb203-36bb-4b89-a125-2d4e596bbf14</serial>
Nov 30 08:36:00 user nova-compute[74963]:     </disk>
Nov 30 08:36:00 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:36:00 user nova-compute[74963]:       <mac address="fa:16:3e:27:b5:61"/>
Nov 30 08:36:00 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:36:00 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:36:00 user nova-compute[74963]:       <target dev="tapd971edba-10"/>
Nov 30 08:36:00 user nova-compute[74963]:     </interface>
Nov 30 08:36:00 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:36:00 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/console.log" append="off"/>
Nov 30 08:36:00 user nova-compute[74963]:     </serial>
Nov 30 08:36:00 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:36:00 user nova-compute[74963]:     <video>
Nov 30 08:36:00 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:36:00 user nova-compute[74963]:     </video>
Nov 30 08:36:00 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:36:00 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:36:00 user nova-compute[74963]:     </rng>
Nov 30 08:36:00 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:36:00 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:36:00 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:36:00 user nova-compute[74963]:     </memballoon>
Nov 30 08:36:00 user nova-compute[74963]:   </devices>
Nov 30 08:36:00 user nova-compute[74963]: </domain>
Nov 30 08:36:00 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:36:00 user nova-compute[74963]: INFO nova.compute.claims [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Claim successful on node user
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'trusted_certs' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.objects.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Object Instance<852f07b2-063c-4225-ba5d-2aa8fd25ea5c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b602f049916319c34c69846ade6565109f0e9c --force-share --output=json" returned: 0 in 0.180s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:00 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:36:00 user nova-compute[74963]: INFO nova.virt.block_device [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Booting with volume 2b5f971c-91df-4e13-b725-5ac9aa071b62 at /dev/vda
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.policy [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '193410ba718b4232a3a4792a584f6834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5cd17a85e84d08b5b068935385ca0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Cannot resize image /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.objects.instance [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'migration_context' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.objects.base [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Object Instance<852f07b2-063c-4225-ba5d-2aa8fd25ea5c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74963) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-350375214',display_name='tempest-TestMinimumBasicScenario-server-350375214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-350375214',id=41,image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNTMdTZqGdn5fGGpuwmipL8JAwunkj6tNUcOg3KCk39VwIlTZ5bPaPdjgX29N8YB3Kn8ib9NsNjsSE3qN3tlCeA2Alp233wU5LJH2Ce5RAQobujjVxxwOiWHItwL02og==',key_name='tempest-TestMinimumBasicScenario-1406737130',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:33:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3a4df22008114c12b02eff15a5b3c228',ramdisk_id='',reservation_id='r-jj18c6oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-171021974',owner_user_name='tempest-TestMinimumBasicScenario-171021974-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:35:57Z,user_data=None,user_id='c6ad4469500b4c01a5ddf6bf2208e955',uuid=852f07b2-063c-4225-ba5d-2aa8fd25ea5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converting VIF {"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG os_vif [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94d2a8e1-4786-5abc-b28d-34c6bf329756', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG os_brick.utils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd971edba-10, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd971edba-10, col_values=(('qos', UUID('baff6ffb-646b-40c1-9202-0a68c65bd829')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd971edba-10, col_values=(('external_ids', {'iface-id': 'd971edba-1059-4e1c-a701-aee51ab5cd59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:b5:61', 'vm-uuid': '852f07b2-063c-4225-ba5d-2aa8fd25ea5c'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b30ef22-331a-476f-8d03-5d5105a8cec1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:00 user nova-compute[74963]: INFO os_vif [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10')
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd6fea1-4fbe-42d3-8349-49941b5cd466]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3a9de6-8d79-49ae-a47a-ead92c4f01eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec42d7f9-8f2c-405b-ac4d-dd8cd48e1386]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:36:00 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:36:00 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9b972-4e1d-4435-8ac5-a7345bec9de3]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG os_brick.utils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:36:00 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Updating existing volume attachment record: b42ba23d-5cb2-4f06-9088-166bfdb55f95 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:36:01 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Successfully created port: 99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Successfully updated port: 99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquired lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-8c721592-5a6b-47f0-b51c-e99004a5baca req-c94ce72d-25f4-4143-959d-6ff69a781013 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Received event network-changed-99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-8c721592-5a6b-47f0-b51c-e99004a5baca req-c94ce72d-25f4-4143-959d-6ff69a781013 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Refreshing instance network info cache due to event network-changed-99bb881b-5044-41a4-bda0-d7dd511658e9. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8c721592-5a6b-47f0-b51c-e99004a5baca req-c94ce72d-25f4-4143-959d-6ff69a781013 service nova] Acquiring lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-2cc197c9-3c41-4ae8-86fb-10d3f600772b req-20a520d2-e7dd-42c2-828a-ff2ac416d59e service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2cc197c9-3c41-4ae8-86fb-10d3f600772b req-20a520d2-e7dd-42c2-828a-ff2ac416d59e service nova] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2cc197c9-3c41-4ae8-86fb-10d3f600772b req-20a520d2-e7dd-42c2-828a-ff2ac416d59e service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-2cc197c9-3c41-4ae8-86fb-10d3f600772b req-20a520d2-e7dd-42c2-828a-ff2ac416d59e service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-2cc197c9-3c41-4ae8-86fb-10d3f600772b req-20a520d2-e7dd-42c2-828a-ff2ac416d59e service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] No waiting events found dispatching network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:02 user nova-compute[74963]: WARNING nova.compute.manager [req-2cc197c9-3c41-4ae8-86fb-10d3f600772b req-20a520d2-e7dd-42c2-828a-ff2ac416d59e service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received unexpected event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 for instance with vm_state active and task_state reboot_started_hard.
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.network.neutron [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Updating instance_info_cache with network_info: [{"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Releasing lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Instance network_info: |[{"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8c721592-5a6b-47f0-b51c-e99004a5baca req-c94ce72d-25f4-4143-959d-6ff69a781013 service nova] Acquired lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.network.neutron [req-8c721592-5a6b-47f0-b51c-e99004a5baca req-c94ce72d-25f4-4143-959d-6ff69a781013 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Refreshing network info cache for port 99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.network.neutron [req-8c721592-5a6b-47f0-b51c-e99004a5baca req-c94ce72d-25f4-4143-959d-6ff69a781013 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Updated VIF entry in instance network info cache for port 99bb881b-5044-41a4-bda0-d7dd511658e9. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG nova.network.neutron [req-8c721592-5a6b-47f0-b51c-e99004a5baca req-c94ce72d-25f4-4143-959d-6ff69a781013 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Updating instance_info_cache with network_info: [{"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:36:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-8c721592-5a6b-47f0-b51c-e99004a5baca req-c94ce72d-25f4-4143-959d-6ff69a781013 service nova] Releasing lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:36:03 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8ee12860-9fdf-44cd-94fd-dee5f0941312 is timed out.
Nov 30 08:36:03 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Successfully detached device vdb from instance 8ee12860-9fdf-44cd-94fd-dee5f0941312 from the live domain config.
Nov 30 08:36:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKkazqYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:36:03 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[835a95e6-b355-466c-99aa-b2eb6326d1f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:36:03 user nova-compute[74963]: No targets found.
Nov 30 08:36:03 user nova-compute[74963]: iSNS:
Nov 30 08:36:03 user nova-compute[74963]: No targets found.
Nov 30 08:36:03 user nova-compute[74963]: STATIC:
Nov 30 08:36:03 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4
Nov 30 08:36:03 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:36:03 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:36:03 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de
Nov 30 08:36:03 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:36:03 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:36:03 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14
Nov 30 08:36:03 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:36:03 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:36:03 user nova-compute[74963]: FIRMWARE:
Nov 30 08:36:03 user nova-compute[74963]: No targets found.
Nov 30 08:36:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:36:03 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:36:03 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcde5d62-2981-4f3a-9acc-6e2d7f325aa1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[303e8248-abc5-43a1-bd15-70fa6f0da023]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:36:03 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:36:03 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:36:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 (non-flash)
Nov 30 08:36:03 user nova-compute[74963]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:36:03 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:36:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624419dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4'): ({'sdb'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Removing single pathed devices sdb {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de799324-5af0-41d1-aaca-9cba75b09b38]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6363af92-043c-43b5-aa2d-1c56321fe307]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Flushing IO for device /dev/sdb {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2443018e-a5a8-4d6c-af0e-73a33d5fc3b0]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d58e84-7185-4413-ae89-eb83a72aa9ca]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] SCSI volumes sdb have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619b43b-05d4-4428-b147-8dcdf0560339]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe275c1-e202-4e8a-b6a6-4839503bf81f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4, portal: 172.16.0.220,3260]
Nov 30 08:36:03 user nova-compute[74963]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4, portal: 172.16.0.220,3260] successful.
Nov 30 08:36:03 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46d7eb7-22e7-4389-a456-0dfddd3c45fc]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] <== disconnect_volume: return (311ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:36:03 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:36:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:36:04 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Instance rebooted successfully.
Nov 30 08:36:04 user nova-compute[74963]: DEBUG nova.compute.manager [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:36:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-5738bcbb-0ebd-4615-a4ed-c5da72c2a92d tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.055s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-6a372d4d-317d-4cd2-9bf3-f00895f313c7 req-5c0680e1-7f28-4251-8f40-081cfc81beb2 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6a372d4d-317d-4cd2-9bf3-f00895f313c7 req-5c0680e1-7f28-4251-8f40-081cfc81beb2 service nova] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6a372d4d-317d-4cd2-9bf3-f00895f313c7 req-5c0680e1-7f28-4251-8f40-081cfc81beb2 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:04 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6a372d4d-317d-4cd2-9bf3-f00895f313c7 req-5c0680e1-7f28-4251-8f40-081cfc81beb2 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:04 user nova-compute[74963]: DEBUG nova.compute.manager [req-6a372d4d-317d-4cd2-9bf3-f00895f313c7 req-5c0680e1-7f28-4251-8f40-081cfc81beb2 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] No waiting events found dispatching network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:04 user nova-compute[74963]: WARNING nova.compute.manager [req-6a372d4d-317d-4cd2-9bf3-f00895f313c7 req-5c0680e1-7f28-4251-8f40-081cfc81beb2 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received unexpected event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 for instance with vm_state active and task_state None.
Nov 30 08:36:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.objects.instance [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'flavor' on Instance uuid 8ee12860-9fdf-44cd-94fd-dee5f0941312 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-b1fa393f-f90b-4abb-8510-b264c5cd4849 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.673s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 27.527s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:10 user nova-compute[74963]: INFO nova.compute.manager [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Terminating instance
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-17e24f05-4307-4f7d-a841-f3313c3ef0d3 req-6f65d84a-c540-4fc3-a2de-3b033a3af0c8 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-unplugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-17e24f05-4307-4f7d-a841-f3313c3ef0d3 req-6f65d84a-c540-4fc3-a2de-3b033a3af0c8 service nova] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-17e24f05-4307-4f7d-a841-f3313c3ef0d3 req-6f65d84a-c540-4fc3-a2de-3b033a3af0c8 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-17e24f05-4307-4f7d-a841-f3313c3ef0d3 req-6f65d84a-c540-4fc3-a2de-3b033a3af0c8 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-17e24f05-4307-4f7d-a841-f3313c3ef0d3 req-6f65d84a-c540-4fc3-a2de-3b033a3af0c8 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] No waiting events found dispatching network-vif-unplugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.compute.manager [req-17e24f05-4307-4f7d-a841-f3313c3ef0d3 req-6f65d84a-c540-4fc3-a2de-3b033a3af0c8 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-unplugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:36:10 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Creating image(s)
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Ensure instance console log exists: /opt/stack/data/nova/instances/1823711f-c16f-4200-a689-994e79c330a5/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Start _get_guest_xml network_info=[{"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrwchYNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1823711f-c16f-4200-a689-994e79c330a5', 'attached_at': '', 'detached_at': '', 'volume_id': '2b5f971c-91df-4e13-b725-5ac9aa071b62', 'serial': '2b5f971c-91df-4e13-b725-5ac9aa071b62'}, 'attachment_id': 'b42ba23d-5cb2-4f06-9088-166bfdb55f95', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:36:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:36:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrwchYNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:36:10 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:36:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:36:10 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:36:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:36:10 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:36:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab7ea31-2c06-4541-aefc-8632562ca7d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:36:10 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1055adfd-de4e-4a27-802d-07dfd81d34a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62] added
Nov 30 08:36:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[21200f08-c4dc-43a9-b675-f05500529c9e]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a0baa-7d90-44da-929c-f94fa928f90b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrwchYNF {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrwchYNF" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[359d055f-e9f2-4496-8918-2c124216e1aa]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrwchYNF'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[723456ed-eeaa-411f-85a1-07f251d56863]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:11 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Instance destroyed successfully.
Nov 30 08:36:11 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'resources' on Instance uuid 8ee12860-9fdf-44cd-94fd-dee5f0941312 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-541614891',display_name='tempest-VolumesSnapshotTestJSON-instance-541614891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-541614891',id=39,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM+rMyQmsArBrN9TfHVW2kV/QahmiBsFyz1hAPlEfN22mEarpc46KV4GR+Q+42DPN2pnB6TRK69Dh82imfnopcoq9FcYUVpNfTSesmpPYADN0zvFz+QuTEARzeP9uqv5A==',key_name='tempest-keypair-860867781',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ac02c3deb7402aa4be7e086036e42d',ramdisk_id='',reservation_id='r-jmmv0vd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1296720269',owner_user_name='tempest-VolumesSnapshotTestJSON-1296720269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:33:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e0833a93c947b09b71cb3a587e219a',uuid=8ee12860-9fdf-44cd-94fd-dee5f0941312,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converting VIF {"id": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "address": "fa:16:3e:0d:ff:4a", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddfc647-e8", "ovs_interfaceid": "7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ff:4a,bridge_name='br-int',has_traffic_filtering=True,id=7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddfc647-e8') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_vif [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ff:4a,bridge_name='br-int',has_traffic_filtering=True,id=7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddfc647-e8') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80018994-66a5-472a-b4ff-b44b69a9338a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:36:11 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:36:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:36:11 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:36:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ddfc647-e8, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb64024b-5a15-4ac7-8031-25e449434941) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:11 user nova-compute[74963]: INFO os_vif [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ff:4a,bridge_name='br-int',has_traffic_filtering=True,id=7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddfc647-e8')
Nov 30 08:36:11 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKkazqYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:36:11 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2788c1e2-c184-418e-bc88-93187de9d66c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62, portal: 172.16.0.220,3260]
Nov 30 08:36:11 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62, portal: 172.16.0.220,3260] successful.
Nov 30 08:36:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7bebf1-1fb6-4410-852e-514a370fe2c9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eadb55f-8a2a-4674-84e1-e296c3b206ee]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:36:11 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:36:11 user nova-compute[74963]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:36:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:36:11 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:36:11 user nova-compute[74963]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:36:11 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3497a06-90ae-45c5-983a-7bb4853e64a8]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrwchYNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:11 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23761313164386136', 'path': '/dev/sdb'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761313164386136', 'path': '/dev/sdb'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.156s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[337bd4f5-b94a-43b7-8538-b85fac1e4e68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:36:12 user nova-compute[74963]: No targets found.
Nov 30 08:36:12 user nova-compute[74963]: iSNS:
Nov 30 08:36:12 user nova-compute[74963]: No targets found.
Nov 30 08:36:12 user nova-compute[74963]: STATIC:
Nov 30 08:36:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de
Nov 30 08:36:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:36:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:36:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14
Nov 30 08:36:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:36:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:36:12 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62
Nov 30 08:36:12 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:36:12 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:36:12 user nova-compute[74963]: FIRMWARE:
Nov 30 08:36:12 user nova-compute[74963]: No targets found.
Nov 30 08:36:12 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:36:12 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:36:12 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626eafb7-b41b-4253-9857-b43d967efdb4', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-177132761',display_name='tempest-TestVolumeBootPattern-volume-backed-server-177132761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-177132761',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKTOdmL/H8oYtQ4y4F0HKJvb9sG/i6y/eRfn1IgVGYzpNvDtGm5y9Lu46Pd3PVApwE4PYwKdPz1Zv9VEewxkmI2A2pKxUdjK+5f6H2uz7Z2CGNV3IkAtNuXSY7ajvyn6w==',key_name='tempest-keypair-230148843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c5cd17a85e84d08b5b068935385ca0c',ramdisk_id='',reservation_id='r-bhqmm5eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1848886466',owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:36:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='193410ba718b4232a3a4792a584f6834',uuid=1823711f-c16f-4200-a689-994e79c330a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converting VIF {"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a9:6c,bridge_name='br-int',has_traffic_filtering=True,id=99bb881b-5044-41a4-bda0-d7dd511658e9,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb881b-50') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.objects.instance [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lazy-loading 'pci_devices' on Instance uuid 1823711f-c16f-4200-a689-994e79c330a5 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:36:12 user nova-compute[74963]:   <uuid>1823711f-c16f-4200-a689-994e79c330a5</uuid>
Nov 30 08:36:12 user nova-compute[74963]:   <name>instance-0000002a</name>
Nov 30 08:36:12 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:36:12 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:36:12 user nova-compute[74963]:   <metadata>
Nov 30 08:36:12 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:36:12 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:36:12 user nova-compute[74963]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-177132761</nova:name>
Nov 30 08:36:12 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:36:10</nova:creationTime>
Nov 30 08:36:12 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:36:12 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:36:12 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:36:12 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:36:12 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:36:12 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:36:12 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:36:12 user nova-compute[74963]:       <nova:owner>
Nov 30 08:36:12 user nova-compute[74963]:         <nova:user uuid="193410ba718b4232a3a4792a584f6834">tempest-TestVolumeBootPattern-1848886466-project-member</nova:user>
Nov 30 08:36:12 user nova-compute[74963]:         <nova:project uuid="4c5cd17a85e84d08b5b068935385ca0c">tempest-TestVolumeBootPattern-1848886466</nova:project>
Nov 30 08:36:12 user nova-compute[74963]:       </nova:owner>
Nov 30 08:36:12 user nova-compute[74963]:       <nova:ports>
Nov 30 08:36:12 user nova-compute[74963]:         <nova:port uuid="99bb881b-5044-41a4-bda0-d7dd511658e9">
Nov 30 08:36:12 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 08:36:12 user nova-compute[74963]:         </nova:port>
Nov 30 08:36:12 user nova-compute[74963]:       </nova:ports>
Nov 30 08:36:12 user nova-compute[74963]:     </nova:instance>
Nov 30 08:36:12 user nova-compute[74963]:   </metadata>
Nov 30 08:36:12 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:36:12 user nova-compute[74963]:     <system>
Nov 30 08:36:12 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:36:12 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:36:12 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:36:12 user nova-compute[74963]:       <entry name="serial">1823711f-c16f-4200-a689-994e79c330a5</entry>
Nov 30 08:36:12 user nova-compute[74963]:       <entry name="uuid">1823711f-c16f-4200-a689-994e79c330a5</entry>
Nov 30 08:36:12 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:36:12 user nova-compute[74963]:     </system>
Nov 30 08:36:12 user nova-compute[74963]:   </sysinfo>
Nov 30 08:36:12 user nova-compute[74963]:   <os>
Nov 30 08:36:12 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:36:12 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:36:12 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:36:12 user nova-compute[74963]:   </os>
Nov 30 08:36:12 user nova-compute[74963]:   <features>
Nov 30 08:36:12 user nova-compute[74963]:     <acpi/>
Nov 30 08:36:12 user nova-compute[74963]:     <apic/>
Nov 30 08:36:12 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:36:12 user nova-compute[74963]:   </features>
Nov 30 08:36:12 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:36:12 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:36:12 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:36:12 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:36:12 user nova-compute[74963]:   </clock>
Nov 30 08:36:12 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:36:12 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:36:12 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:36:12 user nova-compute[74963]:   </cpu>
Nov 30 08:36:12 user nova-compute[74963]:   <devices>
Nov 30 08:36:12 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:36:12 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:36:12 user nova-compute[74963]:       <source dev="/dev/sdb"/>
Nov 30 08:36:12 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:36:12 user nova-compute[74963]:       <serial>2b5f971c-91df-4e13-b725-5ac9aa071b62</serial>
Nov 30 08:36:12 user nova-compute[74963]:     </disk>
Nov 30 08:36:12 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:36:12 user nova-compute[74963]:       <mac address="fa:16:3e:3b:a9:6c"/>
Nov 30 08:36:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:36:12 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:36:12 user nova-compute[74963]:       <target dev="tap99bb881b-50"/>
Nov 30 08:36:12 user nova-compute[74963]:     </interface>
Nov 30 08:36:12 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:36:12 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/1823711f-c16f-4200-a689-994e79c330a5/console.log" append="off"/>
Nov 30 08:36:12 user nova-compute[74963]:     </serial>
Nov 30 08:36:12 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:36:12 user nova-compute[74963]:     <video>
Nov 30 08:36:12 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:36:12 user nova-compute[74963]:     </video>
Nov 30 08:36:12 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:36:12 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:36:12 user nova-compute[74963]:     </rng>
Nov 30 08:36:12 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:36:12 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:36:12 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:36:12 user nova-compute[74963]:     </memballoon>
Nov 30 08:36:12 user nova-compute[74963]:   </devices>
Nov 30 08:36:12 user nova-compute[74963]: </domain>
Nov 30 08:36:12 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-177132761',display_name='tempest-TestVolumeBootPattern-volume-backed-server-177132761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-177132761',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKTOdmL/H8oYtQ4y4F0HKJvb9sG/i6y/eRfn1IgVGYzpNvDtGm5y9Lu46Pd3PVApwE4PYwKdPz1Zv9VEewxkmI2A2pKxUdjK+5f6H2uz7Z2CGNV3IkAtNuXSY7ajvyn6w==',key_name='tempest-keypair-230148843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c5cd17a85e84d08b5b068935385ca0c',ramdisk_id='',reservation_id='r-bhqmm5eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1848886466',owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:36:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='193410ba718b4232a3a4792a584f6834',uuid=1823711f-c16f-4200-a689-994e79c330a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converting VIF {"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a9:6c,bridge_name='br-int',has_traffic_filtering=True,id=99bb881b-5044-41a4-bda0-d7dd511658e9,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb881b-50') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_vif [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a9:6c,bridge_name='br-int',has_traffic_filtering=True,id=99bb881b-5044-41a4-bda0-d7dd511658e9,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb881b-50') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e90499c-9282-4b39-b5ba-1b45e27e6175]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba184bc8-3f47-5d77-9a68-61fbb48afaf3', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99bb881b-50, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99bb881b-50, col_values=(('qos', UUID('583bdd54-918d-4297-aca3-f1f9d6463933')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99bb881b-50, col_values=(('external_ids', {'iface-id': '99bb881b-5044-41a4-bda0-d7dd511658e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:a9:6c', 'vm-uuid': '1823711f-c16f-4200-a689-994e79c330a5'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f4d5cd-28a9-49d3-9b9a-b1b3a28ad0e7]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:36:12 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:36:12 user nova-compute[74963]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:36:12 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:36:12 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:36:12 user nova-compute[74963]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:36:12 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244349360>, {}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Disconnecting from: [] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] <== disconnect_volume: return (1237ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:36:12 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Deleting instance files /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312_del
Nov 30 08:36:12 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Deletion of /opt/stack/data/nova/instances/8ee12860-9fdf-44cd-94fd-dee5f0941312_del complete
Nov 30 08:36:12 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:12 user nova-compute[74963]: INFO os_vif [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a9:6c,bridge_name='br-int',has_traffic_filtering=True,id=99bb881b-5044-41a4-bda0-d7dd511658e9,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb881b-50')
Nov 30 08:36:12 user nova-compute[74963]: INFO nova.compute.manager [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Took 2.16 seconds to destroy the instance on the hypervisor.
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] No VIF found with MAC fa:16:3e:3b:a9:6c, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] No waiting events found dispatching network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:12 user nova-compute[74963]: WARNING nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received unexpected event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 for instance with vm_state active and task_state deleting.
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] No waiting events found dispatching network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:12 user nova-compute[74963]: WARNING nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received unexpected event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 for instance with vm_state active and task_state deleting.
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] No waiting events found dispatching network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:12 user nova-compute[74963]: WARNING nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received unexpected event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 for instance with vm_state active and task_state deleting.
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-unplugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] No waiting events found dispatching network-vif-unplugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-unplugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Acquiring lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:12 user nova-compute[74963]: DEBUG nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] No waiting events found dispatching network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:12 user nova-compute[74963]: WARNING nova.compute.manager [req-88360f5c-6686-4154-8458-0eda4b209874 req-2ecce776-7df9-46dd-9c9a-ac55b7708d32 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received unexpected event network-vif-plugged-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 for instance with vm_state active and task_state deleting.
Nov 30 08:36:13 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:36:13 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Took 0.77 seconds to deallocate network for instance.
Nov 30 08:36:13 user nova-compute[74963]: WARNING nova.volume.cinder [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Attachment d72e38b3-911f-4f55-8332-fb5c1cdc3feb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d72e38b3-911f-4f55-8332-fb5c1cdc3feb. (HTTP 404) (Request-ID: req-6b635666-0214-4a60-8b3f-b036904f4db9)
Nov 30 08:36:13 user nova-compute[74963]: INFO nova.compute.manager [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Took 0.02 seconds to detach 1 volumes for instance.
Nov 30 08:36:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:13 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:36:13 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:36:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:13 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Deleted allocations for instance 8ee12860-9fdf-44cd-94fd-dee5f0941312
Nov 30 08:36:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f0b1007e-c4b0-44f0-9e35-67c626a6fbc9 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "8ee12860-9fdf-44cd-94fd-dee5f0941312" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.330s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] [instance: 8ee12860-9fdf-44cd-94fd-dee5f0941312] Received event network-vif-deleted-7ddfc647-e8e4-4a9d-9ae2-eb0bdcc6c497 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Received event network-vif-plugged-99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] Acquiring lock "1823711f-c16f-4200-a689-994e79c330a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] Lock "1823711f-c16f-4200-a689-994e79c330a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] Lock "1823711f-c16f-4200-a689-994e79c330a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] No waiting events found dispatching network-vif-plugged-99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:14 user nova-compute[74963]: WARNING nova.compute.manager [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Received unexpected event network-vif-plugged-99bb881b-5044-41a4-bda0-d7dd511658e9 for instance with vm_state building and task_state spawning.
Nov 30 08:36:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Received event network-vif-plugged-99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] Acquiring lock "1823711f-c16f-4200-a689-994e79c330a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] Lock "1823711f-c16f-4200-a689-994e79c330a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] Lock "1823711f-c16f-4200-a689-994e79c330a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:14 user nova-compute[74963]: DEBUG nova.compute.manager [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] No waiting events found dispatching network-vif-plugged-99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:14 user nova-compute[74963]: WARNING nova.compute.manager [req-a5309c2d-a0da-4c30-9fc1-f4d91ccb721d req-bb07e2f0-5801-44f2-8bd7-f494d43db880 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Received unexpected event network-vif-plugged-99bb881b-5044-41a4-bda0-d7dd511658e9 for instance with vm_state building and task_state spawning.
Nov 30 08:36:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:15 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:36:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:36:15 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Instance spawned successfully.
Nov 30 08:36:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:36:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:36:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:36:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:36:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:36:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:36:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:36:16 user nova-compute[74963]: INFO nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 30 08:36:16 user nova-compute[74963]: DEBUG nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:36:16 user nova-compute[74963]: INFO nova.compute.manager [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Took 15.99 seconds to build instance.
Nov 30 08:36:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-8071c393-d607-4b3a-8019-7cacb60582cf tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "1823711f-c16f-4200-a689-994e79c330a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.134s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:17 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:36:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:36:23 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:36:23 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8323MB free_disk=25.14604949951172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance d5e59ea5-e429-426c-b89e-17aa7115ce84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1823711f-c16f-4200-a689-994e79c330a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:36:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:25 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:26 user nova-compute[74963]: INFO nova.compute.manager [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Terminating instance
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-e135b4e3-3742-405d-a53f-329dc9becb6e req-be76dc99-cab0-457b-9d38-88d809d9c825 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received event network-vif-unplugged-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e135b4e3-3742-405d-a53f-329dc9becb6e req-be76dc99-cab0-457b-9d38-88d809d9c825 service nova] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e135b4e3-3742-405d-a53f-329dc9becb6e req-be76dc99-cab0-457b-9d38-88d809d9c825 service nova] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e135b4e3-3742-405d-a53f-329dc9becb6e req-be76dc99-cab0-457b-9d38-88d809d9c825 service nova] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-e135b4e3-3742-405d-a53f-329dc9becb6e req-be76dc99-cab0-457b-9d38-88d809d9c825 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] No waiting events found dispatching network-vif-unplugged-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-e135b4e3-3742-405d-a53f-329dc9becb6e req-be76dc99-cab0-457b-9d38-88d809d9c825 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received event network-vif-unplugged-cd8de7e3-a358-48ab-9604-4b126ba45146 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Updating instance_info_cache with network_info: [{"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-89a37a46-76ec-4166-bb1d-c4b50a544bc9" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:36:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Instance destroyed successfully.
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.objects.instance [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'resources' on Instance uuid 89a37a46-76ec-4166-bb1d-c4b50a544bc9 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-332900270',display_name='tempest-AttachVolumeNegativeTest-server-332900270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-332900270',id=40,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADo7hF0AK/jTDyTmuEivZFTK85mszHcngtA9nHbpQFpvwI07uSjelrLBTZIVdwQ4pWafvsFkasBFH2amVPfLlQ1NPjBPxhspz8KkJUqo4bmYdCJKiHBoSeF7J0b44bpSw==',key_name='tempest-keypair-998302173',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-jmwnqksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:33:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=89a37a46-76ec-4166-bb1d-c4b50a544bc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "cd8de7e3-a358-48ab-9604-4b126ba45146", "address": "fa:16:3e:5a:d4:45", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd8de7e3-a3", "ovs_interfaceid": "cd8de7e3-a358-48ab-9604-4b126ba45146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:d4:45,bridge_name='br-int',has_traffic_filtering=True,id=cd8de7e3-a358-48ab-9604-4b126ba45146,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8de7e3-a3') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG os_vif [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:d4:45,bridge_name='br-int',has_traffic_filtering=True,id=cd8de7e3-a358-48ab-9604-4b126ba45146,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8de7e3-a3') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd8de7e3-a3, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=458b3dbd-b659-47e9-a3e4-7c9813777dfb) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:26 user nova-compute[74963]: INFO os_vif [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:d4:45,bridge_name='br-int',has_traffic_filtering=True,id=cd8de7e3-a358-48ab-9604-4b126ba45146,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd8de7e3-a3')
Nov 30 08:36:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Deleting instance files /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9_del
Nov 30 08:36:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Deletion of /opt/stack/data/nova/instances/89a37a46-76ec-4166-bb1d-c4b50a544bc9_del complete
Nov 30 08:36:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:27 user nova-compute[74963]: INFO nova.compute.manager [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 08:36:27 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:36:27 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:36:27 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:36:28 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Took 1.09 seconds to deallocate network for instance.
Nov 30 08:36:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:28 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Deleted allocations for instance 89a37a46-76ec-4166-bb1d-c4b50a544bc9
Nov 30 08:36:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-61a24144-03b2-4c83-b7b6-a853431cebad tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.363s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-a9c62f85-04ea-4db6-8a13-d4df8ddc7fb9 req-acd01f93-4037-4af4-8985-5b1236890977 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received event network-vif-plugged-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a9c62f85-04ea-4db6-8a13-d4df8ddc7fb9 req-acd01f93-4037-4af4-8985-5b1236890977 service nova] Acquiring lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a9c62f85-04ea-4db6-8a13-d4df8ddc7fb9 req-acd01f93-4037-4af4-8985-5b1236890977 service nova] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a9c62f85-04ea-4db6-8a13-d4df8ddc7fb9 req-acd01f93-4037-4af4-8985-5b1236890977 service nova] Lock "89a37a46-76ec-4166-bb1d-c4b50a544bc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-a9c62f85-04ea-4db6-8a13-d4df8ddc7fb9 req-acd01f93-4037-4af4-8985-5b1236890977 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] No waiting events found dispatching network-vif-plugged-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:36:28 user nova-compute[74963]: WARNING nova.compute.manager [req-a9c62f85-04ea-4db6-8a13-d4df8ddc7fb9 req-acd01f93-4037-4af4-8985-5b1236890977 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received unexpected event network-vif-plugged-cd8de7e3-a358-48ab-9604-4b126ba45146 for instance with vm_state deleted and task_state None.
Nov 30 08:36:28 user nova-compute[74963]: DEBUG nova.compute.manager [req-a9c62f85-04ea-4db6-8a13-d4df8ddc7fb9 req-acd01f93-4037-4af4-8985-5b1236890977 service nova] [instance: 89a37a46-76ec-4166-bb1d-c4b50a544bc9] Received event network-vif-deleted-cd8de7e3-a358-48ab-9604-4b126ba45146 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:31 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:36:31 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:36 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:46 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:51 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:36:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:36:56 user nova-compute[74963]: INFO nova.compute.manager [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Detaching volume 24472034-ffa9-4aa5-9d7e-10c3dcb1e3de
Nov 30 08:36:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:56 user nova-compute[74963]: INFO nova.virt.block_device [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Attempting to driver detach volume 24472034-ffa9-4aa5-9d7e-10c3dcb1e3de from mountpoint /dev/vdc
Nov 30 08:36:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Attempting to detach device vdc from instance d5e59ea5-e429-426c-b89e-17aa7115ce84 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:36:56 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:36:56 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:36:56 user nova-compute[74963]:   <target dev="vdc" bus="virtio"/>
Nov 30 08:36:56 user nova-compute[74963]:   <serial>24472034-ffa9-4aa5-9d7e-10c3dcb1e3de</serial>
Nov 30 08:36:56 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 08:36:56 user nova-compute[74963]: </disk>
Nov 30 08:36:56 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:36:56 user nova-compute[74963]: INFO nova.compute.claims [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Claim successful on node user
Nov 30 08:36:56 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Successfully detached device vdc from instance d5e59ea5-e429-426c-b89e-17aa7115ce84 from the persistent domain config.
Nov 30 08:36:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d5e59ea5-e429-426c-b89e-17aa7115ce84 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:36:56 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:36:56 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:36:56 user nova-compute[74963]:   <source dev="/dev/sdc"/>
Nov 30 08:36:56 user nova-compute[74963]:   <target dev="vdc" bus="virtio"/>
Nov 30 08:36:56 user nova-compute[74963]:   <serial>24472034-ffa9-4aa5-9d7e-10c3dcb1e3de</serial>
Nov 30 08:36:56 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 08:36:56 user nova-compute[74963]: </disk>
Nov 30 08:36:56 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:36:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.policy [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56e0833a93c947b09b71cb3a587e219a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ac02c3deb7402aa4be7e086036e42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:36:57 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Creating image(s)
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "/opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "/opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.225s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.260s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk 1073741824" returned: 0 in 0.049s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Successfully created port: a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Cannot resize image /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Ensure instance console log exists: /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Successfully updated port: a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "refresh_cache-6ff2c759-df48-48af-aa22-b11ba470deea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquired lock "refresh_cache-6ff2c759-df48-48af-aa22-b11ba470deea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:36:58 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-e76fec2b-a554-4a2e-b5dd-52f4c10b6fe6 req-de00d626-e20e-4320-a70e-f715bd0408e0 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received event network-changed-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.compute.manager [req-e76fec2b-a554-4a2e-b5dd-52f4c10b6fe6 req-de00d626-e20e-4320-a70e-f715bd0408e0 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Refreshing instance network info cache due to event network-changed-a857b32e-312b-41cb-902f-82d90fe44d70. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e76fec2b-a554-4a2e-b5dd-52f4c10b6fe6 req-de00d626-e20e-4320-a70e-f715bd0408e0 service nova] Acquiring lock "refresh_cache-6ff2c759-df48-48af-aa22-b11ba470deea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.network.neutron [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Updating instance_info_cache with network_info: [{"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Releasing lock "refresh_cache-6ff2c759-df48-48af-aa22-b11ba470deea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Instance network_info: |[{"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e76fec2b-a554-4a2e-b5dd-52f4c10b6fe6 req-de00d626-e20e-4320-a70e-f715bd0408e0 service nova] Acquired lock "refresh_cache-6ff2c759-df48-48af-aa22-b11ba470deea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-e76fec2b-a554-4a2e-b5dd-52f4c10b6fe6 req-de00d626-e20e-4320-a70e-f715bd0408e0 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Refreshing network info cache for port a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Start _get_guest_xml network_info=[{"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:36:59 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:36:59 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1226938884',display_name='tempest-VolumesSnapshotTestJSON-instance-1226938884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1226938884',id=43,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVG1b/xCq6iPVXfB5ZiqfOw0KQYSfQSzPEUrXENGTFeC+VFm+YgQ2ZzY/kPMlL7f+b9sCjpM5UZGYmsDgA/az2UPP9lWrPRUAQvqcQDV8L0aldOr38Z25g+txM5uo/ISQ==',key_name='tempest-keypair-1954909521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ac02c3deb7402aa4be7e086036e42d',ramdisk_id='',reservation_id='r-k6cobwlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1296720269',owner_user_name='tempest-VolumesSnapshotTestJSON-1296720269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e0833a93c947b09b71cb3a587e219a',uuid=6ff2c759-df48-48af-aa22-b11ba470deea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converting VIF {"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0d:15,bridge_name='br-int',has_traffic_filtering=True,id=a857b32e-312b-41cb-902f-82d90fe44d70,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa857b32e-31') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.objects.instance [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ff2c759-df48-48af-aa22-b11ba470deea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:36:59 user nova-compute[74963]:   <uuid>6ff2c759-df48-48af-aa22-b11ba470deea</uuid>
Nov 30 08:36:59 user nova-compute[74963]:   <name>instance-0000002b</name>
Nov 30 08:36:59 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:36:59 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:36:59 user nova-compute[74963]:   <metadata>
Nov 30 08:36:59 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:36:59 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:36:59 user nova-compute[74963]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1226938884</nova:name>
Nov 30 08:36:59 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:36:59</nova:creationTime>
Nov 30 08:36:59 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:36:59 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:36:59 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:36:59 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:36:59 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:36:59 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:36:59 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:36:59 user nova-compute[74963]:       <nova:owner>
Nov 30 08:36:59 user nova-compute[74963]:         <nova:user uuid="56e0833a93c947b09b71cb3a587e219a">tempest-VolumesSnapshotTestJSON-1296720269-project-member</nova:user>
Nov 30 08:36:59 user nova-compute[74963]:         <nova:project uuid="f9ac02c3deb7402aa4be7e086036e42d">tempest-VolumesSnapshotTestJSON-1296720269</nova:project>
Nov 30 08:36:59 user nova-compute[74963]:       </nova:owner>
Nov 30 08:36:59 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:36:59 user nova-compute[74963]:       <nova:ports>
Nov 30 08:36:59 user nova-compute[74963]:         <nova:port uuid="a857b32e-312b-41cb-902f-82d90fe44d70">
Nov 30 08:36:59 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 08:36:59 user nova-compute[74963]:         </nova:port>
Nov 30 08:36:59 user nova-compute[74963]:       </nova:ports>
Nov 30 08:36:59 user nova-compute[74963]:     </nova:instance>
Nov 30 08:36:59 user nova-compute[74963]:   </metadata>
Nov 30 08:36:59 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:36:59 user nova-compute[74963]:     <system>
Nov 30 08:36:59 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:36:59 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:36:59 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:36:59 user nova-compute[74963]:       <entry name="serial">6ff2c759-df48-48af-aa22-b11ba470deea</entry>
Nov 30 08:36:59 user nova-compute[74963]:       <entry name="uuid">6ff2c759-df48-48af-aa22-b11ba470deea</entry>
Nov 30 08:36:59 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:36:59 user nova-compute[74963]:     </system>
Nov 30 08:36:59 user nova-compute[74963]:   </sysinfo>
Nov 30 08:36:59 user nova-compute[74963]:   <os>
Nov 30 08:36:59 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:36:59 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:36:59 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:36:59 user nova-compute[74963]:   </os>
Nov 30 08:36:59 user nova-compute[74963]:   <features>
Nov 30 08:36:59 user nova-compute[74963]:     <acpi/>
Nov 30 08:36:59 user nova-compute[74963]:     <apic/>
Nov 30 08:36:59 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:36:59 user nova-compute[74963]:   </features>
Nov 30 08:36:59 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:36:59 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:36:59 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:36:59 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:36:59 user nova-compute[74963]:   </clock>
Nov 30 08:36:59 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:36:59 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:36:59 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:36:59 user nova-compute[74963]:   </cpu>
Nov 30 08:36:59 user nova-compute[74963]:   <devices>
Nov 30 08:36:59 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:36:59 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:36:59 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk"/>
Nov 30 08:36:59 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:36:59 user nova-compute[74963]:     </disk>
Nov 30 08:36:59 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:36:59 user nova-compute[74963]:       <mac address="fa:16:3e:fd:0d:15"/>
Nov 30 08:36:59 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:36:59 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:36:59 user nova-compute[74963]:       <target dev="tapa857b32e-31"/>
Nov 30 08:36:59 user nova-compute[74963]:     </interface>
Nov 30 08:36:59 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:36:59 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/console.log" append="off"/>
Nov 30 08:36:59 user nova-compute[74963]:     </serial>
Nov 30 08:36:59 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:36:59 user nova-compute[74963]:     <video>
Nov 30 08:36:59 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:36:59 user nova-compute[74963]:     </video>
Nov 30 08:36:59 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:36:59 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:36:59 user nova-compute[74963]:     </rng>
Nov 30 08:36:59 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:36:59 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:36:59 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:36:59 user nova-compute[74963]:     </memballoon>
Nov 30 08:36:59 user nova-compute[74963]:   </devices>
Nov 30 08:36:59 user nova-compute[74963]: </domain>
Nov 30 08:36:59 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1226938884',display_name='tempest-VolumesSnapshotTestJSON-instance-1226938884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1226938884',id=43,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVG1b/xCq6iPVXfB5ZiqfOw0KQYSfQSzPEUrXENGTFeC+VFm+YgQ2ZzY/kPMlL7f+b9sCjpM5UZGYmsDgA/az2UPP9lWrPRUAQvqcQDV8L0aldOr38Z25g+txM5uo/ISQ==',key_name='tempest-keypair-1954909521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ac02c3deb7402aa4be7e086036e42d',ramdisk_id='',reservation_id='r-k6cobwlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1296720269',owner_user_name='tempest-VolumesSnapshotTestJSON-1296720269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e0833a93c947b09b71cb3a587e219a',uuid=6ff2c759-df48-48af-aa22-b11ba470deea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converting VIF {"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0d:15,bridge_name='br-int',has_traffic_filtering=True,id=a857b32e-312b-41cb-902f-82d90fe44d70,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa857b32e-31') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG os_vif [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0d:15,bridge_name='br-int',has_traffic_filtering=True,id=a857b32e-312b-41cb-902f-82d90fe44d70,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa857b32e-31') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ace215d1-5fbf-5131-af73-b8b365a37863', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa857b32e-31, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa857b32e-31, col_values=(('qos', UUID('f3906389-f795-4f57-b0f0-28463b010711')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa857b32e-31, col_values=(('external_ids', {'iface-id': 'a857b32e-312b-41cb-902f-82d90fe44d70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:0d:15', 'vm-uuid': '6ff2c759-df48-48af-aa22-b11ba470deea'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:36:59 user nova-compute[74963]: INFO os_vif [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0d:15,bridge_name='br-int',has_traffic_filtering=True,id=a857b32e-312b-41cb-902f-82d90fe44d70,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa857b32e-31')
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No VIF found with MAC fa:16:3e:fd:0d:15, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-e76fec2b-a554-4a2e-b5dd-52f4c10b6fe6 req-de00d626-e20e-4320-a70e-f715bd0408e0 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Updated VIF entry in instance network info cache for port a857b32e-312b-41cb-902f-82d90fe44d70. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG nova.network.neutron [req-e76fec2b-a554-4a2e-b5dd-52f4c10b6fe6 req-de00d626-e20e-4320-a70e-f715bd0408e0 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Updating instance_info_cache with network_info: [{"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-e76fec2b-a554-4a2e-b5dd-52f4c10b6fe6 req-de00d626-e20e-4320-a70e-f715bd0408e0 service nova] Releasing lock "refresh_cache-6ff2c759-df48-48af-aa22-b11ba470deea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:36:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-6b5c35c7-6220-436e-b178-882924f8e2e7 req-aeb9ca18-220f-46bd-9b63-b00deb16417c service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received event network-vif-plugged-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6b5c35c7-6220-436e-b178-882924f8e2e7 req-aeb9ca18-220f-46bd-9b63-b00deb16417c service nova] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6b5c35c7-6220-436e-b178-882924f8e2e7 req-aeb9ca18-220f-46bd-9b63-b00deb16417c service nova] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6b5c35c7-6220-436e-b178-882924f8e2e7 req-aeb9ca18-220f-46bd-9b63-b00deb16417c service nova] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-6b5c35c7-6220-436e-b178-882924f8e2e7 req-aeb9ca18-220f-46bd-9b63-b00deb16417c service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] No waiting events found dispatching network-vif-plugged-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:37:00 user nova-compute[74963]: WARNING nova.compute.manager [req-6b5c35c7-6220-436e-b178-882924f8e2e7 req-aeb9ca18-220f-46bd-9b63-b00deb16417c service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received unexpected event network-vif-plugged-a857b32e-312b-41cb-902f-82d90fe44d70 for instance with vm_state building and task_state spawning.
Nov 30 08:37:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:01 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:37:02 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Instance spawned successfully.
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:02 user nova-compute[74963]: INFO nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:37:02 user nova-compute[74963]: INFO nova.compute.manager [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Took 5.95 seconds to build instance.
Nov 30 08:37:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-f1bcd9a8-6fd9-4eda-83e6-7af1cac1f9a1 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.062s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-a57ce939-594b-47c9-9e8b-6a14a6d72263 req-1dae0544-44d9-42e4-b002-75ff81ceafe6 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received event network-vif-plugged-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a57ce939-594b-47c9-9e8b-6a14a6d72263 req-1dae0544-44d9-42e4-b002-75ff81ceafe6 service nova] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a57ce939-594b-47c9-9e8b-6a14a6d72263 req-1dae0544-44d9-42e4-b002-75ff81ceafe6 service nova] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a57ce939-594b-47c9-9e8b-6a14a6d72263 req-1dae0544-44d9-42e4-b002-75ff81ceafe6 service nova] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:02 user nova-compute[74963]: DEBUG nova.compute.manager [req-a57ce939-594b-47c9-9e8b-6a14a6d72263 req-1dae0544-44d9-42e4-b002-75ff81ceafe6 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] No waiting events found dispatching network-vif-plugged-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:37:02 user nova-compute[74963]: WARNING nova.compute.manager [req-a57ce939-594b-47c9-9e8b-6a14a6d72263 req-1dae0544-44d9-42e4-b002-75ff81ceafe6 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received unexpected event network-vif-plugged-a857b32e-312b-41cb-902f-82d90fe44d70 for instance with vm_state active and task_state None.
Nov 30 08:37:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:37:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:37:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:37:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:37:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:17 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d5e59ea5-e429-426c-b89e-17aa7115ce84 is timed out.
Nov 30 08:37:17 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Successfully detached device vdc from instance d5e59ea5-e429-426c-b89e-17aa7115ce84 from the live domain config.
Nov 30 08:37:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRTKjESi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:37:17 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c048114f-d2ec-45c0-982d-f90b1e8588fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:37:17 user nova-compute[74963]: No targets found.
Nov 30 08:37:17 user nova-compute[74963]: iSNS:
Nov 30 08:37:17 user nova-compute[74963]: No targets found.
Nov 30 08:37:17 user nova-compute[74963]: STATIC:
Nov 30 08:37:17 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de
Nov 30 08:37:17 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:37:17 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:37:17 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14
Nov 30 08:37:17 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:37:17 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:37:17 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62
Nov 30 08:37:17 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:37:17 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:37:17 user nova-compute[74963]: FIRMWARE:
Nov 30 08:37:17 user nova-compute[74963]: No targets found.
Nov 30 08:37:17 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:37:17 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:37:17 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a241cab6-0d26-4536-b7bb-bbe64af64c3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[94679e9e-0c30-4e5c-bfb5-37779aba2a15]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:37:17 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:37:17 user nova-compute[74963]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:37:17 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de (non-flash)
Nov 30 08:37:17 user nova-compute[74963]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:37:17 user nova-compute[74963]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:37:17 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62203d9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de'): ({'sdc'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Removing single pathed devices sdc {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[33faed06-082f-4735-8de9-34169a4b137c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59c051a-329d-4e71-8e25-a99ea1f2636d]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Flushing IO for device /dev/sdc {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6613344e-8626-48c5-9fc8-4d49cdd39edf]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f8d21-5ed4-4c47-8dab-526fddf83627]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9876fd-b75c-4946-8e84-b510504c8206]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e73e5f-29fc-44e2-8339-2ce9e0f40ea6]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de, portal: 172.16.0.220,3260]
Nov 30 08:37:17 user nova-compute[74963]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de, portal: 172.16.0.220,3260] successful.
Nov 30 08:37:17 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24472034-ffa9-4aa5-9d7e-10c3dcb1e3de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce2300a-0ae0-40ec-bb96-8dd654561290]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] <== disconnect_volume: return (316ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:37:17 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:37:18 user nova-compute[74963]: DEBUG nova.objects.instance [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'flavor' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:37:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-fe275cea-d454-4443-bbc7-020545b26108 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:37:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:37:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74963) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 08:37:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:37:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74963) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 08:37:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:37:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:37:20 user nova-compute[74963]: INFO nova.compute.claims [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Claim successful on node user
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Refreshing inventories for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Updating ProviderTree inventory for provider 41961ac9-576a-4a02-a5e7-459f54657b3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Updating inventory in ProviderTree for provider 41961ac9-576a-4a02-a5e7-459f54657b3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Refreshing aggregate associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, aggregates: None {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Refreshing trait associations for resource provider 41961ac9-576a-4a02-a5e7-459f54657b3f, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74963) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:37:20 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:37:20 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG nova.policy [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '960072c79ce2402d83f2d6fba0bf77de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2164e77b2f554d9b8eecac876545849b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:37:21 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Creating image(s)
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "/opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "/opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk 1073741824" returned: 0 in 0.055s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Successfully created port: 2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Cannot resize image /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Ensure instance console log exists: /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Successfully updated port: 2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "refresh_cache-b3273f7d-7427-443e-bd17-ab4fb74e61d1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquired lock "refresh_cache-b3273f7d-7427-443e-bd17-ab4fb74e61d1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-05fdd411-4582-4927-8127-eb934be3fa96 req-03719044-83ca-42af-81eb-94d5cbf53cf8 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Received event network-changed-2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.compute.manager [req-05fdd411-4582-4927-8127-eb934be3fa96 req-03719044-83ca-42af-81eb-94d5cbf53cf8 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Refreshing instance network info cache due to event network-changed-2db46775-eab2-4fb8-bab4-4011a1e47968. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-05fdd411-4582-4927-8127-eb934be3fa96 req-03719044-83ca-42af-81eb-94d5cbf53cf8 service nova] Acquiring lock "refresh_cache-b3273f7d-7427-443e-bd17-ab4fb74e61d1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.network.neutron [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Updating instance_info_cache with network_info: [{"id": "2db46775-eab2-4fb8-bab4-4011a1e47968", "address": "fa:16:3e:40:f1:b9", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db46775-ea", "ovs_interfaceid": "2db46775-eab2-4fb8-bab4-4011a1e47968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Releasing lock "refresh_cache-b3273f7d-7427-443e-bd17-ab4fb74e61d1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Instance network_info: |[{"id": "2db46775-eab2-4fb8-bab4-4011a1e47968", "address": "fa:16:3e:40:f1:b9", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db46775-ea", "ovs_interfaceid": "2db46775-eab2-4fb8-bab4-4011a1e47968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-05fdd411-4582-4927-8127-eb934be3fa96 req-03719044-83ca-42af-81eb-94d5cbf53cf8 service nova] Acquired lock "refresh_cache-b3273f7d-7427-443e-bd17-ab4fb74e61d1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.network.neutron [req-05fdd411-4582-4927-8127-eb934be3fa96 req-03719044-83ca-42af-81eb-94d5cbf53cf8 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Refreshing network info cache for port 2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Start _get_guest_xml network_info=[{"id": "2db46775-eab2-4fb8-bab4-4011a1e47968", "address": "fa:16:3e:40:f1:b9", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db46775-ea", "ovs_interfaceid": "2db46775-eab2-4fb8-bab4-4011a1e47968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:37:22 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:37:22 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:37:22 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1527999803',display_name='tempest-AttachVolumeNegativeTest-server-1527999803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1527999803',id=44,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP/2UNdb+QZfG9+YNEZF2gkU5WSxkKzUOE6um16cKLxJhTUFTRC7Q71+MXtgccVjXbm0JkF94XC2IhGZqwa6jlZySceCAkZ4FFZGsSKT+8/bHTx+1CK23mwh06pt1yOKQ==',key_name='tempest-keypair-1598384907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-l9kh538k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=b3273f7d-7427-443e-bd17-ab4fb74e61d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2db46775-eab2-4fb8-bab4-4011a1e47968", "address": "fa:16:3e:40:f1:b9", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db46775-ea", "ovs_interfaceid": "2db46775-eab2-4fb8-bab4-4011a1e47968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "2db46775-eab2-4fb8-bab4-4011a1e47968", "address": "fa:16:3e:40:f1:b9", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db46775-ea", "ovs_interfaceid": "2db46775-eab2-4fb8-bab4-4011a1e47968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=2db46775-eab2-4fb8-bab4-4011a1e47968,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db46775-ea') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.objects.instance [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'pci_devices' on Instance uuid b3273f7d-7427-443e-bd17-ab4fb74e61d1 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:37:23 user nova-compute[74963]:   <uuid>b3273f7d-7427-443e-bd17-ab4fb74e61d1</uuid>
Nov 30 08:37:23 user nova-compute[74963]:   <name>instance-0000002c</name>
Nov 30 08:37:23 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:37:23 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:37:23 user nova-compute[74963]:   <metadata>
Nov 30 08:37:23 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:37:23 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:37:23 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1527999803</nova:name>
Nov 30 08:37:23 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:37:22</nova:creationTime>
Nov 30 08:37:23 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:37:23 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:37:23 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:37:23 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:37:23 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:37:23 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:37:23 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:37:23 user nova-compute[74963]:       <nova:owner>
Nov 30 08:37:23 user nova-compute[74963]:         <nova:user uuid="960072c79ce2402d83f2d6fba0bf77de">tempest-AttachVolumeNegativeTest-1676573190-project-member</nova:user>
Nov 30 08:37:23 user nova-compute[74963]:         <nova:project uuid="2164e77b2f554d9b8eecac876545849b">tempest-AttachVolumeNegativeTest-1676573190</nova:project>
Nov 30 08:37:23 user nova-compute[74963]:       </nova:owner>
Nov 30 08:37:23 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:37:23 user nova-compute[74963]:       <nova:ports>
Nov 30 08:37:23 user nova-compute[74963]:         <nova:port uuid="2db46775-eab2-4fb8-bab4-4011a1e47968">
Nov 30 08:37:23 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 08:37:23 user nova-compute[74963]:         </nova:port>
Nov 30 08:37:23 user nova-compute[74963]:       </nova:ports>
Nov 30 08:37:23 user nova-compute[74963]:     </nova:instance>
Nov 30 08:37:23 user nova-compute[74963]:   </metadata>
Nov 30 08:37:23 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:37:23 user nova-compute[74963]:     <system>
Nov 30 08:37:23 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:37:23 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:37:23 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:37:23 user nova-compute[74963]:       <entry name="serial">b3273f7d-7427-443e-bd17-ab4fb74e61d1</entry>
Nov 30 08:37:23 user nova-compute[74963]:       <entry name="uuid">b3273f7d-7427-443e-bd17-ab4fb74e61d1</entry>
Nov 30 08:37:23 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:37:23 user nova-compute[74963]:     </system>
Nov 30 08:37:23 user nova-compute[74963]:   </sysinfo>
Nov 30 08:37:23 user nova-compute[74963]:   <os>
Nov 30 08:37:23 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:37:23 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:37:23 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:37:23 user nova-compute[74963]:   </os>
Nov 30 08:37:23 user nova-compute[74963]:   <features>
Nov 30 08:37:23 user nova-compute[74963]:     <acpi/>
Nov 30 08:37:23 user nova-compute[74963]:     <apic/>
Nov 30 08:37:23 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:37:23 user nova-compute[74963]:   </features>
Nov 30 08:37:23 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:37:23 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:37:23 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:37:23 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:37:23 user nova-compute[74963]:   </clock>
Nov 30 08:37:23 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:37:23 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:37:23 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:37:23 user nova-compute[74963]:   </cpu>
Nov 30 08:37:23 user nova-compute[74963]:   <devices>
Nov 30 08:37:23 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:37:23 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:37:23 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk"/>
Nov 30 08:37:23 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:37:23 user nova-compute[74963]:     </disk>
Nov 30 08:37:23 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:37:23 user nova-compute[74963]:       <mac address="fa:16:3e:40:f1:b9"/>
Nov 30 08:37:23 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:37:23 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:37:23 user nova-compute[74963]:       <target dev="tap2db46775-ea"/>
Nov 30 08:37:23 user nova-compute[74963]:     </interface>
Nov 30 08:37:23 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:37:23 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/console.log" append="off"/>
Nov 30 08:37:23 user nova-compute[74963]:     </serial>
Nov 30 08:37:23 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:37:23 user nova-compute[74963]:     <video>
Nov 30 08:37:23 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:37:23 user nova-compute[74963]:     </video>
Nov 30 08:37:23 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:37:23 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:37:23 user nova-compute[74963]:     </rng>
Nov 30 08:37:23 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:37:23 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:37:23 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:37:23 user nova-compute[74963]:     </memballoon>
Nov 30 08:37:23 user nova-compute[74963]:   </devices>
Nov 30 08:37:23 user nova-compute[74963]: </domain>
Nov 30 08:37:23 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1527999803',display_name='tempest-AttachVolumeNegativeTest-server-1527999803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1527999803',id=44,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP/2UNdb+QZfG9+YNEZF2gkU5WSxkKzUOE6um16cKLxJhTUFTRC7Q71+MXtgccVjXbm0JkF94XC2IhGZqwa6jlZySceCAkZ4FFZGsSKT+8/bHTx+1CK23mwh06pt1yOKQ==',key_name='tempest-keypair-1598384907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2164e77b2f554d9b8eecac876545849b',ramdisk_id='',reservation_id='r-l9kh538k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1676573190',owner_user_name='tempest-AttachVolumeNegativeTest-1676573190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960072c79ce2402d83f2d6fba0bf77de',uuid=b3273f7d-7427-443e-bd17-ab4fb74e61d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2db46775-eab2-4fb8-bab4-4011a1e47968", "address": "fa:16:3e:40:f1:b9", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db46775-ea", "ovs_interfaceid": "2db46775-eab2-4fb8-bab4-4011a1e47968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converting VIF {"id": "2db46775-eab2-4fb8-bab4-4011a1e47968", "address": "fa:16:3e:40:f1:b9", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db46775-ea", "ovs_interfaceid": "2db46775-eab2-4fb8-bab4-4011a1e47968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=2db46775-eab2-4fb8-bab4-4011a1e47968,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db46775-ea') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG os_vif [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=2db46775-eab2-4fb8-bab4-4011a1e47968,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db46775-ea') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2e38354-44f3-529b-8b30-9de5af8ef624', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2db46775-ea, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2db46775-ea, col_values=(('qos', UUID('023ccdbe-c567-40c1-b822-7dc0cb16489f')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2db46775-ea, col_values=(('external_ids', {'iface-id': '2db46775-eab2-4fb8-bab4-4011a1e47968', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:f1:b9', 'vm-uuid': 'b3273f7d-7427-443e-bd17-ab4fb74e61d1'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:23 user nova-compute[74963]: INFO os_vif [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=2db46775-eab2-4fb8-bab4-4011a1e47968,network=Network(9f0c33ea-12b5-4737-8622-4e01c5af5ef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db46775-ea')
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No VIF found with MAC fa:16:3e:40:f1:b9, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.network.neutron [req-05fdd411-4582-4927-8127-eb934be3fa96 req-03719044-83ca-42af-81eb-94d5cbf53cf8 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Updated VIF entry in instance network info cache for port 2db46775-eab2-4fb8-bab4-4011a1e47968. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.network.neutron [req-05fdd411-4582-4927-8127-eb934be3fa96 req-03719044-83ca-42af-81eb-94d5cbf53cf8 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Updating instance_info_cache with network_info: [{"id": "2db46775-eab2-4fb8-bab4-4011a1e47968", "address": "fa:16:3e:40:f1:b9", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db46775-ea", "ovs_interfaceid": "2db46775-eab2-4fb8-bab4-4011a1e47968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-05fdd411-4582-4927-8127-eb934be3fa96 req-03719044-83ca-42af-81eb-94d5cbf53cf8 service nova] Releasing lock "refresh_cache-b3273f7d-7427-443e-bd17-ab4fb74e61d1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:37:23 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-f7b34ed1-3d8e-41b3-b813-f0df697fe9c6 req-69356d8b-b33d-480f-ba78-1c07a1561adf service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Received event network-vif-plugged-2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f7b34ed1-3d8e-41b3-b813-f0df697fe9c6 req-69356d8b-b33d-480f-ba78-1c07a1561adf service nova] Acquiring lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f7b34ed1-3d8e-41b3-b813-f0df697fe9c6 req-69356d8b-b33d-480f-ba78-1c07a1561adf service nova] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f7b34ed1-3d8e-41b3-b813-f0df697fe9c6 req-69356d8b-b33d-480f-ba78-1c07a1561adf service nova] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-f7b34ed1-3d8e-41b3-b813-f0df697fe9c6 req-69356d8b-b33d-480f-ba78-1c07a1561adf service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] No waiting events found dispatching network-vif-plugged-2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:37:26 user nova-compute[74963]: WARNING nova.compute.manager [req-f7b34ed1-3d8e-41b3-b813-f0df697fe9c6 req-69356d8b-b33d-480f-ba78-1c07a1561adf service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Received unexpected event network-vif-plugged-2db46775-eab2-4fb8-bab4-4011a1e47968 for instance with vm_state building and task_state spawning.
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-85f091fb-c076-4660-a56b-c1b1669fb221 req-f4e2d52d-0aa7-4d74-b0ad-d5435e2a4a10 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Received event network-vif-plugged-2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-85f091fb-c076-4660-a56b-c1b1669fb221 req-f4e2d52d-0aa7-4d74-b0ad-d5435e2a4a10 service nova] Acquiring lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-85f091fb-c076-4660-a56b-c1b1669fb221 req-f4e2d52d-0aa7-4d74-b0ad-d5435e2a4a10 service nova] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-85f091fb-c076-4660-a56b-c1b1669fb221 req-f4e2d52d-0aa7-4d74-b0ad-d5435e2a4a10 service nova] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.manager [req-85f091fb-c076-4660-a56b-c1b1669fb221 req-f4e2d52d-0aa7-4d74-b0ad-d5435e2a4a10 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] No waiting events found dispatching network-vif-plugged-2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:37:26 user nova-compute[74963]: WARNING nova.compute.manager [req-85f091fb-c076-4660-a56b-c1b1669fb221 req-f4e2d52d-0aa7-4d74-b0ad-d5435e2a4a10 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Received unexpected event network-vif-plugged-2db46775-eab2-4fb8-bab4-4011a1e47968 for instance with vm_state building and task_state spawning.
Nov 30 08:37:26 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:37:26 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8446MB free_disk=25.128524780273438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:26 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Instance spawned successfully.
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:37:26 user nova-compute[74963]: INFO nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance d5e59ea5-e429-426c-b89e-17aa7115ce84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1823711f-c16f-4200-a689-994e79c330a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 6ff2c759-df48-48af-aa22-b11ba470deea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance b3273f7d-7427-443e-bd17-ab4fb74e61d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:37:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:37:26 user nova-compute[74963]: INFO nova.compute.manager [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Took 6.66 seconds to build instance.
Nov 30 08:37:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-e5653d39-c37c-480f-a146-06b7811449eb tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.764s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:27 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:37:27 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:37:27 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:37:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:28 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:37:33 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:38 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:44 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74963) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 08:37:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Cleaning up deleted instances {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] There are 0 instances to clean {{(pid=74963) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:47 user nova-compute[74963]: INFO nova.compute.manager [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Terminating instance
Nov 30 08:37:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-fbbf828d-c8fd-40fc-acbe-9009f5e8e278 req-8c2d46e5-6b0b-444b-b665-1c30fd392dc8 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-unplugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fbbf828d-c8fd-40fc-acbe-9009f5e8e278 req-8c2d46e5-6b0b-444b-b665-1c30fd392dc8 service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fbbf828d-c8fd-40fc-acbe-9009f5e8e278 req-8c2d46e5-6b0b-444b-b665-1c30fd392dc8 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-fbbf828d-c8fd-40fc-acbe-9009f5e8e278 req-8c2d46e5-6b0b-444b-b665-1c30fd392dc8 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-fbbf828d-c8fd-40fc-acbe-9009f5e8e278 req-8c2d46e5-6b0b-444b-b665-1c30fd392dc8 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-unplugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:37:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-fbbf828d-c8fd-40fc-acbe-9009f5e8e278 req-8c2d46e5-6b0b-444b-b665-1c30fd392dc8 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-unplugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:37:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Instance destroyed successfully.
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'resources' on Instance uuid d5e59ea5-e429-426c-b89e-17aa7115ce84 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T08:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1988636161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1988636161',id=37,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPd4ASO80Kxi3NHD7OzgG3rXjragYl5NaXFAooh4ILUBXsjowt7I1YJBq0LOLUQMt8ITVotCYy3URmr4FfibwpVsXxiCTTUY3cIEhaGOBJ0iKmY0rHDe3iKGQAj7fVjtg==',key_name='tempest-keypair-1641280519',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:35:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36c9009714354721a7697c14258ffc7d',ramdisk_id='',reservation_id='r-lytpxy1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1943160204',owner_user_name='tempest-AttachVolumeShelveTestJSON-1943160204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad49a6fbce944b719e6f09a5e2bd1b30',uuid=d5e59ea5-e429-426c-b89e-17aa7115ce84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converting VIF {"id": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "address": "fa:16:3e:07:c6:af", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36b3ac9-f1", "ovs_interfaceid": "c36b3ac9-f1fb-4f70-8954-cc14592bf6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG os_vif [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc36b3ac9-f1, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12d0937c-f515-4736-854e-fbd4b171d73b) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:37:48 user nova-compute[74963]: INFO os_vif [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:af,bridge_name='br-int',has_traffic_filtering=True,id=c36b3ac9-f1fb-4f70-8954-cc14592bf6c2,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36b3ac9-f1')
Nov 30 08:37:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Deleting instance files /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84_del
Nov 30 08:37:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Deletion of /opt/stack/data/nova/instances/d5e59ea5-e429-426c-b89e-17aa7115ce84_del complete
Nov 30 08:37:48 user nova-compute[74963]: INFO nova.compute.manager [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 30 08:37:48 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:37:48 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Took 0.62 seconds to deallocate network for instance.
Nov 30 08:37:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-cce1d642-4190-49fd-86f3-1542ea78972e req-f8cf7697-5f75-4b34-b4fe-7702f3c00ba4 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-cce1d642-4190-49fd-86f3-1542ea78972e req-f8cf7697-5f75-4b34-b4fe-7702f3c00ba4 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing instance network info cache due to event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cce1d642-4190-49fd-86f3-1542ea78972e req-f8cf7697-5f75-4b34-b4fe-7702f3c00ba4 service nova] Acquiring lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cce1d642-4190-49fd-86f3-1542ea78972e req-f8cf7697-5f75-4b34-b4fe-7702f3c00ba4 service nova] Acquired lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.network.neutron [req-cce1d642-4190-49fd-86f3-1542ea78972e req-f8cf7697-5f75-4b34-b4fe-7702f3c00ba4 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:37:48 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:49 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Deleted allocations for instance d5e59ea5-e429-426c-b89e-17aa7115ce84
Nov 30 08:37:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-16519141-d3fc-4f64-b048-41c112e66e51 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.874s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-568fdacb-c833-47ef-b122-4d9341825c9a req-74b118a2-43dc-4350-816a-b8699eb56256 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-568fdacb-c833-47ef-b122-4d9341825c9a req-74b118a2-43dc-4350-816a-b8699eb56256 service nova] Acquiring lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-568fdacb-c833-47ef-b122-4d9341825c9a req-74b118a2-43dc-4350-816a-b8699eb56256 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-568fdacb-c833-47ef-b122-4d9341825c9a req-74b118a2-43dc-4350-816a-b8699eb56256 service nova] Lock "d5e59ea5-e429-426c-b89e-17aa7115ce84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-568fdacb-c833-47ef-b122-4d9341825c9a req-74b118a2-43dc-4350-816a-b8699eb56256 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] No waiting events found dispatching network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:37:49 user nova-compute[74963]: WARNING nova.compute.manager [req-568fdacb-c833-47ef-b122-4d9341825c9a req-74b118a2-43dc-4350-816a-b8699eb56256 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received unexpected event network-vif-plugged-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 for instance with vm_state deleted and task_state None.
Nov 30 08:37:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-568fdacb-c833-47ef-b122-4d9341825c9a req-74b118a2-43dc-4350-816a-b8699eb56256 service nova] [instance: d5e59ea5-e429-426c-b89e-17aa7115ce84] Received event network-vif-deleted-c36b3ac9-f1fb-4f70-8954-cc14592bf6c2 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG nova.network.neutron [req-cce1d642-4190-49fd-86f3-1542ea78972e req-f8cf7697-5f75-4b34-b4fe-7702f3c00ba4 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updated VIF entry in instance network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG nova.network.neutron [req-cce1d642-4190-49fd-86f3-1542ea78972e req-f8cf7697-5f75-4b34-b4fe-7702f3c00ba4 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-cce1d642-4190-49fd-86f3-1542ea78972e req-f8cf7697-5f75-4b34-b4fe-7702f3c00ba4 service nova] Releasing lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:49 user nova-compute[74963]: INFO nova.compute.manager [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Detaching volume 56fcb203-36bb-4b89-a125-2d4e596bbf14
Nov 30 08:37:49 user nova-compute[74963]: INFO nova.virt.block_device [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Attempting to driver detach volume 56fcb203-36bb-4b89-a125-2d4e596bbf14 from mountpoint /dev/vdb
Nov 30 08:37:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Attempting to detach device vdb from instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:37:49 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:37:49 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:37:49 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:37:49 user nova-compute[74963]:   <serial>56fcb203-36bb-4b89-a125-2d4e596bbf14</serial>
Nov 30 08:37:49 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 08:37:49 user nova-compute[74963]: </disk>
Nov 30 08:37:49 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:37:49 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Successfully detached device vdb from instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c from the persistent domain config.
Nov 30 08:37:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:37:49 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:37:49 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:37:49 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:37:49 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:37:49 user nova-compute[74963]:   <serial>56fcb203-36bb-4b89-a125-2d4e596bbf14</serial>
Nov 30 08:37:49 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 08:37:49 user nova-compute[74963]: </disk>
Nov 30 08:37:49 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:37:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:37:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-6d1079a0-97dc-459a-a28d-b53dba495498 req-0a7733eb-5c77-46f2-bd97-e585728a5c37 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-6d1079a0-97dc-459a-a28d-b53dba495498 req-0a7733eb-5c77-46f2-bd97-e585728a5c37 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing instance network info cache due to event network-changed-d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:37:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6d1079a0-97dc-459a-a28d-b53dba495498 req-0a7733eb-5c77-46f2-bd97-e585728a5c37 service nova] Acquiring lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:37:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6d1079a0-97dc-459a-a28d-b53dba495498 req-0a7733eb-5c77-46f2-bd97-e585728a5c37 service nova] Acquired lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:37:50 user nova-compute[74963]: DEBUG nova.network.neutron [req-6d1079a0-97dc-459a-a28d-b53dba495498 req-0a7733eb-5c77-46f2-bd97-e585728a5c37 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Refreshing network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-16210672-036f-42c5-95f9-8173c16a34d8 req-e57e9a9f-f59f-4fde-b3b3-6146056d33f9 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Received event network-changed-99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG nova.compute.manager [req-16210672-036f-42c5-95f9-8173c16a34d8 req-e57e9a9f-f59f-4fde-b3b3-6146056d33f9 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Refreshing instance network info cache due to event network-changed-99bb881b-5044-41a4-bda0-d7dd511658e9. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-16210672-036f-42c5-95f9-8173c16a34d8 req-e57e9a9f-f59f-4fde-b3b3-6146056d33f9 service nova] Acquiring lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-16210672-036f-42c5-95f9-8173c16a34d8 req-e57e9a9f-f59f-4fde-b3b3-6146056d33f9 service nova] Acquired lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG nova.network.neutron [req-16210672-036f-42c5-95f9-8173c16a34d8 req-e57e9a9f-f59f-4fde-b3b3-6146056d33f9 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Refreshing network info cache for port 99bb881b-5044-41a4-bda0-d7dd511658e9 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG nova.network.neutron [req-6d1079a0-97dc-459a-a28d-b53dba495498 req-0a7733eb-5c77-46f2-bd97-e585728a5c37 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updated VIF entry in instance network info cache for port d971edba-1059-4e1c-a701-aee51ab5cd59. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG nova.network.neutron [req-6d1079a0-97dc-459a-a28d-b53dba495498 req-0a7733eb-5c77-46f2-bd97-e585728a5c37 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-6d1079a0-97dc-459a-a28d-b53dba495498 req-0a7733eb-5c77-46f2-bd97-e585728a5c37 service nova] Releasing lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG nova.network.neutron [req-16210672-036f-42c5-95f9-8173c16a34d8 req-e57e9a9f-f59f-4fde-b3b3-6146056d33f9 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Updated VIF entry in instance network info cache for port 99bb881b-5044-41a4-bda0-d7dd511658e9. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG nova.network.neutron [req-16210672-036f-42c5-95f9-8173c16a34d8 req-e57e9a9f-f59f-4fde-b3b3-6146056d33f9 service nova] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Updating instance_info_cache with network_info: [{"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:37:51 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-16210672-036f-42c5-95f9-8173c16a34d8 req-e57e9a9f-f59f-4fde-b3b3-6146056d33f9 service nova] Releasing lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:37:53 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:56 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:58 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "41d8b782-5b70-48bf-9489-fca44341eff7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "41d8b782-5b70-48bf-9489-fca44341eff7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:58 user nova-compute[74963]: DEBUG nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:37:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:37:58 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:37:58 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:37:58 user nova-compute[74963]: INFO nova.compute.claims [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Claim successful on node user
Nov 30 08:37:59 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:37:59 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:37:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:37:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:37:59 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:37:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:37:59 user nova-compute[74963]: DEBUG nova.network.neutron [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:37:59 user nova-compute[74963]: DEBUG nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:37:59 user nova-compute[74963]: INFO nova.virt.block_device [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Booting with volume snapshot 12853f6f-8abc-4c39-9f08-c7e820dbb0b9 at /dev/vda
Nov 30 08:37:59 user nova-compute[74963]: DEBUG nova.policy [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '193410ba718b4232a3a4792a584f6834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5cd17a85e84d08b5b068935385ca0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:37:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:37:59 user nova-compute[74963]: DEBUG nova.network.neutron [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Successfully created port: 01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Successfully updated port: 01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "refresh_cache-41d8b782-5b70-48bf-9489-fca44341eff7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquired lock "refresh_cache-41d8b782-5b70-48bf-9489-fca44341eff7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-a0cab369-e0a2-4b8a-b79c-34f41cb7f516 req-ee7f6717-924a-4468-9fe5-4ed8f31966b8 service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received event network-changed-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG nova.compute.manager [req-a0cab369-e0a2-4b8a-b79c-34f41cb7f516 req-ee7f6717-924a-4468-9fe5-4ed8f31966b8 service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Refreshing instance network info cache due to event network-changed-01fdc05f-3d59-483a-889c-87bb025b716e. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0cab369-e0a2-4b8a-b79c-34f41cb7f516 req-ee7f6717-924a-4468-9fe5-4ed8f31966b8 service nova] Acquiring lock "refresh_cache-41d8b782-5b70-48bf-9489-fca44341eff7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG nova.network.neutron [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Updating instance_info_cache with network_info: [{"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Releasing lock "refresh_cache-41d8b782-5b70-48bf-9489-fca44341eff7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Instance network_info: |[{"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0cab369-e0a2-4b8a-b79c-34f41cb7f516 req-ee7f6717-924a-4468-9fe5-4ed8f31966b8 service nova] Acquired lock "refresh_cache-41d8b782-5b70-48bf-9489-fca44341eff7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:38:00 user nova-compute[74963]: DEBUG nova.network.neutron [req-a0cab369-e0a2-4b8a-b79c-34f41cb7f516 req-ee7f6717-924a-4468-9fe5-4ed8f31966b8 service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Refreshing network info cache for port 01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:38:01 user nova-compute[74963]: DEBUG nova.network.neutron [req-a0cab369-e0a2-4b8a-b79c-34f41cb7f516 req-ee7f6717-924a-4468-9fe5-4ed8f31966b8 service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Updated VIF entry in instance network info cache for port 01fdc05f-3d59-483a-889c-87bb025b716e. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:38:01 user nova-compute[74963]: DEBUG nova.network.neutron [req-a0cab369-e0a2-4b8a-b79c-34f41cb7f516 req-ee7f6717-924a-4468-9fe5-4ed8f31966b8 service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Updating instance_info_cache with network_info: [{"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:38:01 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-a0cab369-e0a2-4b8a-b79c-34f41cb7f516 req-ee7f6717-924a-4468-9fe5-4ed8f31966b8 service nova] Releasing lock "refresh_cache-41d8b782-5b70-48bf-9489-fca44341eff7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:38:03 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG os_brick.utils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec702dde-94ec-4e6c-b9ec-15a3e0ddcce0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ad1ef5-8775-46e2-ab16-889c6c4c6b15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[73410807-18bd-42ed-ac81-69755a20e35b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4fcf84-193e-4877-a3cb-d7d3cf8e87b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:04 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:38:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:38:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:05 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:38:05 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:38:05 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b4188d-5a6a-41f1-a0ad-9a79626137ff]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:38:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:38:05 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:38:05 user nova-compute[74963]: DEBUG os_brick.utils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:38:05 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Updating existing volume attachment record: edbec7b2-ff2f-43ad-bfec-508ec780a929 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:38:08 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:10 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c is timed out.
Nov 30 08:38:10 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Successfully detached device vdb from instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c from the live domain config.
Nov 30 08:38:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJUHQvkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:38:10 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3225cb52-ae92-4efd-892e-ede70eb7d26f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:38:10 user nova-compute[74963]: No targets found.
Nov 30 08:38:10 user nova-compute[74963]: iSNS:
Nov 30 08:38:10 user nova-compute[74963]: No targets found.
Nov 30 08:38:10 user nova-compute[74963]: STATIC:
Nov 30 08:38:10 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14
Nov 30 08:38:10 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:38:10 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:38:10 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62
Nov 30 08:38:10 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:38:10 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:38:10 user nova-compute[74963]: FIRMWARE:
Nov 30 08:38:10 user nova-compute[74963]: No targets found.
Nov 30 08:38:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:38:10 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:38:10 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a843042-3030-4022-9b29-10b41103c104]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[154fbdf3-994c-4aec-b657-7e7e12cd5883]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:38:10 user nova-compute[74963]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 (non-flash)
Nov 30 08:38:10 user nova-compute[74963]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62442385e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14'): ({'sdd'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Removing single pathed devices sdd {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3279464-d546-43a8-b3fc-352c648b0876]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3487c9be-d322-44b7-a411-978fc58c02ae]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Flushing IO for device /dev/sdd {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1342f1-b0a3-456c-946b-9691180c375f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79b7a50-bbbb-467d-bf44-312e3d2f0474]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f73a91-8d38-4fb8-913b-c77c66a16ff6]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf77505-cbe4-4990-9a9d-7746d4d83923]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260]
Nov 30 08:38:10 user nova-compute[74963]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14, portal: 172.16.0.220,3260] successful.
Nov 30 08:38:10 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fcb203-36bb-4b89-a125-2d4e596bbf14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a1137c-fd08-41aa-956e-b5e4eceede21]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] <== disconnect_volume: return (289ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:38:10 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:38:11 user nova-compute[74963]: DEBUG nova.objects.instance [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'flavor' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:38:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-c9740a64-745d-4b6b-a3c8-9aee2ef97ce4 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:38:13 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Creating image(s)
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Did not create local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Ensure instance console log exists: /opt/stack/data/nova/instances/41d8b782-5b70-48bf-9489-fca44341eff7/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Start _get_guest_xml network_info=[{"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T08:37:52Z,direct_url=<?>,disk_format='qcow2',id=5a7f9dae-c1c7-459e-a9a9-aa790d04d171,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1749274841',owner='4c5cd17a85e84d08b5b068935385ca0c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T08:37:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHoFIOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '41d8b782-5b70-48bf-9489-fca44341eff7', 'attached_at': '', 'detached_at': '', 'volume_id': '7cccc812-5249-4278-8e01-39923723650c', 'serial': '7cccc812-5249-4278-8e01-39923723650c'}, 'attachment_id': 'edbec7b2-ff2f-43ad-bfec-508ec780a929', 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:38:13 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:38:13 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T08:37:52Z,direct_url=<?>,disk_format='qcow2',id=5a7f9dae-c1c7-459e-a9a9-aa790d04d171,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1749274841',owner='4c5cd17a85e84d08b5b068935385ca0c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T08:37:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHoFIOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:38:13 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:38:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:38:13 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:38:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:38:13 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:38:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ff9973-a8e0-46ef-92bc-9688450c312c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:38:13 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dce4c80-ec85-47a6-94f7-f75feff97270]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c] added
Nov 30 08:38:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5423f212-a141-4564-9aef-5c09b978e26b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e94a513-e45a-46b4-b813-1d3588745215]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxHoFIOZ {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxHoFIOZ" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[88627427-fcc7-409e-9acd-59a984f4aae0]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gxHoFIOZ'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff32596-baaa-4109-8b87-76e9da4d682f]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a351b86a-ae6f-4432-83e9-08451a04aeb1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dc99cd-09ee-4f56-9161-5b6a66056036]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c, portal: 172.16.0.220,3260]
Nov 30 08:38:14 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c, portal: 172.16.0.220,3260] successful.
Nov 30 08:38:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b131bc1e-d235-4919-9f61-52ce6467b43b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6733fc6-0545-431c-b56d-21363dac5f6c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:14 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:38:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:14 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:38:14 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2520f67c-b9db-4fcc-bc93-24156aec0ff8]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:14 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHoFIOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23533336633376465', 'path': '/dev/sdc'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533336633376465', 'path': '/dev/sdc'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1682838524',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1682838524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1682838524',id=45,image_ref='5a7f9dae-c1c7-459e-a9a9-aa790d04d171',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPVXOferItC4gkHy3NWJGk9JJD4e9GR0GB6njhJhT2Q2LGHFFk/TmvQ3nE9L9Y08K9mZRrdU2x8nUJzRujXAgT+NncUoosqQSo4193r/RrH7fHljR2yMqWNs+mDiHcNvg==',key_name='tempest-keypair-2079079981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c5cd17a85e84d08b5b068935385ca0c',ramdisk_id='',reservation_id='r-w8fkr6pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1848886466',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1848886466',owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='193410ba718b4232a3a4792a584f6834',uuid=41d8b782-5b70-48bf-9489-fca44341eff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converting VIF {"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:2a:f4,bridge_name='br-int',has_traffic_filtering=True,id=01fdc05f-3d59-483a-889c-87bb025b716e,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fdc05f-3d') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.objects.instance [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lazy-loading 'pci_devices' on Instance uuid 41d8b782-5b70-48bf-9489-fca44341eff7 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:38:15 user nova-compute[74963]:   <uuid>41d8b782-5b70-48bf-9489-fca44341eff7</uuid>
Nov 30 08:38:15 user nova-compute[74963]:   <name>instance-0000002d</name>
Nov 30 08:38:15 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:38:15 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:38:15 user nova-compute[74963]:   <metadata>
Nov 30 08:38:15 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:38:15 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:38:15 user nova-compute[74963]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1682838524</nova:name>
Nov 30 08:38:15 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:38:13</nova:creationTime>
Nov 30 08:38:15 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:38:15 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:38:15 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:38:15 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:38:15 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:38:15 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:38:15 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:38:15 user nova-compute[74963]:       <nova:owner>
Nov 30 08:38:15 user nova-compute[74963]:         <nova:user uuid="193410ba718b4232a3a4792a584f6834">tempest-TestVolumeBootPattern-1848886466-project-member</nova:user>
Nov 30 08:38:15 user nova-compute[74963]:         <nova:project uuid="4c5cd17a85e84d08b5b068935385ca0c">tempest-TestVolumeBootPattern-1848886466</nova:project>
Nov 30 08:38:15 user nova-compute[74963]:       </nova:owner>
Nov 30 08:38:15 user nova-compute[74963]:       <nova:root type="image" uuid="5a7f9dae-c1c7-459e-a9a9-aa790d04d171"/>
Nov 30 08:38:15 user nova-compute[74963]:       <nova:ports>
Nov 30 08:38:15 user nova-compute[74963]:         <nova:port uuid="01fdc05f-3d59-483a-889c-87bb025b716e">
Nov 30 08:38:15 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 08:38:15 user nova-compute[74963]:         </nova:port>
Nov 30 08:38:15 user nova-compute[74963]:       </nova:ports>
Nov 30 08:38:15 user nova-compute[74963]:     </nova:instance>
Nov 30 08:38:15 user nova-compute[74963]:   </metadata>
Nov 30 08:38:15 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:38:15 user nova-compute[74963]:     <system>
Nov 30 08:38:15 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:38:15 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:38:15 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:38:15 user nova-compute[74963]:       <entry name="serial">41d8b782-5b70-48bf-9489-fca44341eff7</entry>
Nov 30 08:38:15 user nova-compute[74963]:       <entry name="uuid">41d8b782-5b70-48bf-9489-fca44341eff7</entry>
Nov 30 08:38:15 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:38:15 user nova-compute[74963]:     </system>
Nov 30 08:38:15 user nova-compute[74963]:   </sysinfo>
Nov 30 08:38:15 user nova-compute[74963]:   <os>
Nov 30 08:38:15 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:38:15 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:38:15 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:38:15 user nova-compute[74963]:   </os>
Nov 30 08:38:15 user nova-compute[74963]:   <features>
Nov 30 08:38:15 user nova-compute[74963]:     <acpi/>
Nov 30 08:38:15 user nova-compute[74963]:     <apic/>
Nov 30 08:38:15 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:38:15 user nova-compute[74963]:   </features>
Nov 30 08:38:15 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:38:15 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:38:15 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:38:15 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:38:15 user nova-compute[74963]:   </clock>
Nov 30 08:38:15 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:38:15 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:38:15 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:38:15 user nova-compute[74963]:   </cpu>
Nov 30 08:38:15 user nova-compute[74963]:   <devices>
Nov 30 08:38:15 user nova-compute[74963]:     <disk type="block" device="disk">
Nov 30 08:38:15 user nova-compute[74963]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:38:15 user nova-compute[74963]:       <source dev="/dev/sdc"/>
Nov 30 08:38:15 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:38:15 user nova-compute[74963]:       <serial>7cccc812-5249-4278-8e01-39923723650c</serial>
Nov 30 08:38:15 user nova-compute[74963]:     </disk>
Nov 30 08:38:15 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:38:15 user nova-compute[74963]:       <mac address="fa:16:3e:61:2a:f4"/>
Nov 30 08:38:15 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:38:15 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:38:15 user nova-compute[74963]:       <target dev="tap01fdc05f-3d"/>
Nov 30 08:38:15 user nova-compute[74963]:     </interface>
Nov 30 08:38:15 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:38:15 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/41d8b782-5b70-48bf-9489-fca44341eff7/console.log" append="off"/>
Nov 30 08:38:15 user nova-compute[74963]:     </serial>
Nov 30 08:38:15 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:38:15 user nova-compute[74963]:     <video>
Nov 30 08:38:15 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:38:15 user nova-compute[74963]:     </video>
Nov 30 08:38:15 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:38:15 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:38:15 user nova-compute[74963]:     </rng>
Nov 30 08:38:15 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:38:15 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:38:15 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:38:15 user nova-compute[74963]:     </memballoon>
Nov 30 08:38:15 user nova-compute[74963]:   </devices>
Nov 30 08:38:15 user nova-compute[74963]: </domain>
Nov 30 08:38:15 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1682838524',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1682838524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1682838524',id=45,image_ref='5a7f9dae-c1c7-459e-a9a9-aa790d04d171',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPVXOferItC4gkHy3NWJGk9JJD4e9GR0GB6njhJhT2Q2LGHFFk/TmvQ3nE9L9Y08K9mZRrdU2x8nUJzRujXAgT+NncUoosqQSo4193r/RrH7fHljR2yMqWNs+mDiHcNvg==',key_name='tempest-keypair-2079079981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c5cd17a85e84d08b5b068935385ca0c',ramdisk_id='',reservation_id='r-w8fkr6pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1848886466',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1848886466',owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='193410ba718b4232a3a4792a584f6834',uuid=41d8b782-5b70-48bf-9489-fca44341eff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converting VIF {"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:2a:f4,bridge_name='br-int',has_traffic_filtering=True,id=01fdc05f-3d59-483a-889c-87bb025b716e,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fdc05f-3d') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG os_vif [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2a:f4,bridge_name='br-int',has_traffic_filtering=True,id=01fdc05f-3d59-483a-889c-87bb025b716e,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fdc05f-3d') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9362e9f-254c-5021-867b-c53d2b10ee8f', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01fdc05f-3d, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01fdc05f-3d, col_values=(('qos', UUID('d8b8f55e-eb2f-43a6-a74b-8677f93524e0')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01fdc05f-3d, col_values=(('external_ids', {'iface-id': '01fdc05f-3d59-483a-889c-87bb025b716e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:2a:f4', 'vm-uuid': '41d8b782-5b70-48bf-9489-fca44341eff7'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:15 user nova-compute[74963]: INFO os_vif [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2a:f4,bridge_name='br-int',has_traffic_filtering=True,id=01fdc05f-3d59-483a-889c-87bb025b716e,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fdc05f-3d')
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:38:15 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] No VIF found with MAC fa:16:3e:61:2a:f4, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:38:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-619a818c-763a-405e-b5a2-807f5c7bcdcf req-09736e17-f6d3-438f-9880-ff8da0272d7f service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received event network-vif-plugged-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-619a818c-763a-405e-b5a2-807f5c7bcdcf req-09736e17-f6d3-438f-9880-ff8da0272d7f service nova] Acquiring lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-619a818c-763a-405e-b5a2-807f5c7bcdcf req-09736e17-f6d3-438f-9880-ff8da0272d7f service nova] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:16 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-619a818c-763a-405e-b5a2-807f5c7bcdcf req-09736e17-f6d3-438f-9880-ff8da0272d7f service nova] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:16 user nova-compute[74963]: DEBUG nova.compute.manager [req-619a818c-763a-405e-b5a2-807f5c7bcdcf req-09736e17-f6d3-438f-9880-ff8da0272d7f service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] No waiting events found dispatching network-vif-plugged-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:38:16 user nova-compute[74963]: WARNING nova.compute.manager [req-619a818c-763a-405e-b5a2-807f5c7bcdcf req-09736e17-f6d3-438f-9880-ff8da0272d7f service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received unexpected event network-vif-plugged-01fdc05f-3d59-483a-889c-87bb025b716e for instance with vm_state building and task_state spawning.
Nov 30 08:38:16 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:18 user nova-compute[74963]: DEBUG nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:38:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:38:18 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Instance spawned successfully.
Nov 30 08:38:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:38:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:38:18 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:38:18 user nova-compute[74963]: INFO nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Took 4.83 seconds to spawn the instance on the hypervisor.
Nov 30 08:38:18 user nova-compute[74963]: DEBUG nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:38:18 user nova-compute[74963]: DEBUG nova.compute.manager [req-094f9cb7-452c-4d0d-af9d-b6e5ea9a6bc2 req-3ccf6083-e07a-475a-9c8f-9be62a82a14c service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received event network-vif-plugged-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-094f9cb7-452c-4d0d-af9d-b6e5ea9a6bc2 req-3ccf6083-e07a-475a-9c8f-9be62a82a14c service nova] Acquiring lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-094f9cb7-452c-4d0d-af9d-b6e5ea9a6bc2 req-3ccf6083-e07a-475a-9c8f-9be62a82a14c service nova] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-094f9cb7-452c-4d0d-af9d-b6e5ea9a6bc2 req-3ccf6083-e07a-475a-9c8f-9be62a82a14c service nova] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:18 user nova-compute[74963]: DEBUG nova.compute.manager [req-094f9cb7-452c-4d0d-af9d-b6e5ea9a6bc2 req-3ccf6083-e07a-475a-9c8f-9be62a82a14c service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] No waiting events found dispatching network-vif-plugged-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:38:18 user nova-compute[74963]: WARNING nova.compute.manager [req-094f9cb7-452c-4d0d-af9d-b6e5ea9a6bc2 req-3ccf6083-e07a-475a-9c8f-9be62a82a14c service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received unexpected event network-vif-plugged-01fdc05f-3d59-483a-889c-87bb025b716e for instance with vm_state building and task_state spawning.
Nov 30 08:38:18 user nova-compute[74963]: INFO nova.compute.manager [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Took 20.05 seconds to build instance.
Nov 30 08:38:18 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-52093108-300f-4339-b3f8-4eba9036e1d8 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "41d8b782-5b70-48bf-9489-fca44341eff7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.161s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Rebuilding the list of instances to heal {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG nova.objects.instance [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lazy-loading 'info_cache' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [{"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-852f07b2-063c-4225-ba5d-2aa8fd25ea5c" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:24 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:38:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:38:26 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:38:26 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8437MB free_disk=25.124202728271484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1823711f-c16f-4200-a689-994e79c330a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 6ff2c759-df48-48af-aa22-b11ba470deea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance b3273f7d-7427-443e-bd17-ab4fb74e61d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 41d8b782-5b70-48bf-9489-fca44341eff7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:27 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:28 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:28 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:28 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:38:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:38:31 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:34 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:35 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:38:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:37 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "07fdb716-7ff0-4a70-b084-ddeb23f0fb9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "07fdb716-7ff0-4a70-b084-ddeb23f0fb9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:38:41 user nova-compute[74963]: INFO nova.compute.claims [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Claim successful on node user
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.network.neutron [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:38:41 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.policy [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad49a6fbce944b719e6f09a5e2bd1b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c9009714354721a7697c14258ffc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:38:41 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Creating image(s)
Nov 30 08:38:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "/opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "/opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "/opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.250s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.212s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520,backing_fmt=raw /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk 1073741824" returned: 0 in 0.052s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "5a4e932b3e57486f63485cf53d18dd3b795f5520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4e932b3e57486f63485cf53d18dd3b795f5520 --force-share --output=json" returned: 0 in 0.187s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Cannot resize image /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Ensure instance console log exists: /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:42 user nova-compute[74963]: DEBUG nova.network.neutron [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Successfully created port: 2281cf92-6cc5-41e7-965f-b6daaa5fcd20 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.network.neutron [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Successfully updated port: 2281cf92-6cc5-41e7-965f-b6daaa5fcd20 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquiring lock "refresh_cache-07fdb716-7ff0-4a70-b084-ddeb23f0fb9b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Acquired lock "refresh_cache-07fdb716-7ff0-4a70-b084-ddeb23f0fb9b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.network.neutron [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.network.neutron [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-011e180a-d566-42ec-a3d6-e90debebb450 req-72a13a2d-8d14-4edd-bff8-bcfd3b4dc73e service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Received event network-changed-2281cf92-6cc5-41e7-965f-b6daaa5fcd20 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-011e180a-d566-42ec-a3d6-e90debebb450 req-72a13a2d-8d14-4edd-bff8-bcfd3b4dc73e service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Refreshing instance network info cache due to event network-changed-2281cf92-6cc5-41e7-965f-b6daaa5fcd20. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-011e180a-d566-42ec-a3d6-e90debebb450 req-72a13a2d-8d14-4edd-bff8-bcfd3b4dc73e service nova] Acquiring lock "refresh_cache-07fdb716-7ff0-4a70-b084-ddeb23f0fb9b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.network.neutron [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Updating instance_info_cache with network_info: [{"id": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "address": "fa:16:3e:89:99:e2", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2281cf92-6c", "ovs_interfaceid": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Releasing lock "refresh_cache-07fdb716-7ff0-4a70-b084-ddeb23f0fb9b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Instance network_info: |[{"id": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "address": "fa:16:3e:89:99:e2", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2281cf92-6c", "ovs_interfaceid": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-011e180a-d566-42ec-a3d6-e90debebb450 req-72a13a2d-8d14-4edd-bff8-bcfd3b4dc73e service nova] Acquired lock "refresh_cache-07fdb716-7ff0-4a70-b084-ddeb23f0fb9b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.network.neutron [req-011e180a-d566-42ec-a3d6-e90debebb450 req-72a13a2d-8d14-4edd-bff8-bcfd3b4dc73e service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Refreshing network info cache for port 2281cf92-6cc5-41e7-965f-b6daaa5fcd20 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Start _get_guest_xml network_info=[{"id": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "address": "fa:16:3e:89:99:e2", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2281cf92-6c", "ovs_interfaceid": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'ea262e08-aaf0-444c-be1e-ba1d8691ac72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:38:43 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:38:43 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:02:19Z,direct_url=<?>,disk_format='qcow2',id=ea262e08-aaf0-444c-be1e-ba1d8691ac72,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3413d8ecba84668a83468962f5fe459',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-588824808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-588824808',id=46,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuHKy4iM9HPiGKqTy05CXN3vxgR0MkyyL9AEbJao0J1QIYIC1CrZ2Guz6oRqT9ekLabr0wEc8iYRYtxFrd095mFApeKgapM6bPiYC+lwKAY2+htmK+UUloNOZ+Y/H4Fgg==',key_name='tempest-keypair-579804356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36c9009714354721a7697c14258ffc7d',ramdisk_id='',reservation_id='r-7c3s7ayz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1943160204',owner_user_name='tempest-AttachVolumeShelveTestJSON-1943160204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad49a6fbce944b719e6f09a5e2bd1b30',uuid=07fdb716-7ff0-4a70-b084-ddeb23f0fb9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "address": "fa:16:3e:89:99:e2", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2281cf92-6c", "ovs_interfaceid": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converting VIF {"id": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "address": "fa:16:3e:89:99:e2", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2281cf92-6c", "ovs_interfaceid": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:e2,bridge_name='br-int',has_traffic_filtering=True,id=2281cf92-6cc5-41e7-965f-b6daaa5fcd20,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2281cf92-6c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.objects.instance [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lazy-loading 'pci_devices' on Instance uuid 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:38:43 user nova-compute[74963]:   <uuid>07fdb716-7ff0-4a70-b084-ddeb23f0fb9b</uuid>
Nov 30 08:38:43 user nova-compute[74963]:   <name>instance-0000002e</name>
Nov 30 08:38:43 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:38:43 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:38:43 user nova-compute[74963]:   <metadata>
Nov 30 08:38:43 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:38:43 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:38:43 user nova-compute[74963]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-588824808</nova:name>
Nov 30 08:38:43 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:38:43</nova:creationTime>
Nov 30 08:38:43 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:38:43 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:38:43 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:38:43 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:38:43 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:38:43 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:38:43 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:38:43 user nova-compute[74963]:       <nova:owner>
Nov 30 08:38:43 user nova-compute[74963]:         <nova:user uuid="ad49a6fbce944b719e6f09a5e2bd1b30">tempest-AttachVolumeShelveTestJSON-1943160204-project-member</nova:user>
Nov 30 08:38:43 user nova-compute[74963]:         <nova:project uuid="36c9009714354721a7697c14258ffc7d">tempest-AttachVolumeShelveTestJSON-1943160204</nova:project>
Nov 30 08:38:43 user nova-compute[74963]:       </nova:owner>
Nov 30 08:38:43 user nova-compute[74963]:       <nova:root type="image" uuid="ea262e08-aaf0-444c-be1e-ba1d8691ac72"/>
Nov 30 08:38:43 user nova-compute[74963]:       <nova:ports>
Nov 30 08:38:43 user nova-compute[74963]:         <nova:port uuid="2281cf92-6cc5-41e7-965f-b6daaa5fcd20">
Nov 30 08:38:43 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 08:38:43 user nova-compute[74963]:         </nova:port>
Nov 30 08:38:43 user nova-compute[74963]:       </nova:ports>
Nov 30 08:38:43 user nova-compute[74963]:     </nova:instance>
Nov 30 08:38:43 user nova-compute[74963]:   </metadata>
Nov 30 08:38:43 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:38:43 user nova-compute[74963]:     <system>
Nov 30 08:38:43 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:38:43 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:38:43 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:38:43 user nova-compute[74963]:       <entry name="serial">07fdb716-7ff0-4a70-b084-ddeb23f0fb9b</entry>
Nov 30 08:38:43 user nova-compute[74963]:       <entry name="uuid">07fdb716-7ff0-4a70-b084-ddeb23f0fb9b</entry>
Nov 30 08:38:43 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:38:43 user nova-compute[74963]:     </system>
Nov 30 08:38:43 user nova-compute[74963]:   </sysinfo>
Nov 30 08:38:43 user nova-compute[74963]:   <os>
Nov 30 08:38:43 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:38:43 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:38:43 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:38:43 user nova-compute[74963]:   </os>
Nov 30 08:38:43 user nova-compute[74963]:   <features>
Nov 30 08:38:43 user nova-compute[74963]:     <acpi/>
Nov 30 08:38:43 user nova-compute[74963]:     <apic/>
Nov 30 08:38:43 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:38:43 user nova-compute[74963]:   </features>
Nov 30 08:38:43 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:38:43 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:38:43 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:38:43 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:38:43 user nova-compute[74963]:   </clock>
Nov 30 08:38:43 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:38:43 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:38:43 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:38:43 user nova-compute[74963]:   </cpu>
Nov 30 08:38:43 user nova-compute[74963]:   <devices>
Nov 30 08:38:43 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:38:43 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:38:43 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk"/>
Nov 30 08:38:43 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:38:43 user nova-compute[74963]:     </disk>
Nov 30 08:38:43 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:38:43 user nova-compute[74963]:       <mac address="fa:16:3e:89:99:e2"/>
Nov 30 08:38:43 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:38:43 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:38:43 user nova-compute[74963]:       <target dev="tap2281cf92-6c"/>
Nov 30 08:38:43 user nova-compute[74963]:     </interface>
Nov 30 08:38:43 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:38:43 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/console.log" append="off"/>
Nov 30 08:38:43 user nova-compute[74963]:     </serial>
Nov 30 08:38:43 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:38:43 user nova-compute[74963]:     <video>
Nov 30 08:38:43 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:38:43 user nova-compute[74963]:     </video>
Nov 30 08:38:43 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:38:43 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:38:43 user nova-compute[74963]:     </rng>
Nov 30 08:38:43 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:38:43 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:38:43 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:38:43 user nova-compute[74963]:     </memballoon>
Nov 30 08:38:43 user nova-compute[74963]:   </devices>
Nov 30 08:38:43 user nova-compute[74963]: </domain>
Nov 30 08:38:43 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-588824808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-588824808',id=46,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuHKy4iM9HPiGKqTy05CXN3vxgR0MkyyL9AEbJao0J1QIYIC1CrZ2Guz6oRqT9ekLabr0wEc8iYRYtxFrd095mFApeKgapM6bPiYC+lwKAY2+htmK+UUloNOZ+Y/H4Fgg==',key_name='tempest-keypair-579804356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36c9009714354721a7697c14258ffc7d',ramdisk_id='',reservation_id='r-7c3s7ayz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1943160204',owner_user_name='tempest-AttachVolumeShelveTestJSON-1943160204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad49a6fbce944b719e6f09a5e2bd1b30',uuid=07fdb716-7ff0-4a70-b084-ddeb23f0fb9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "address": "fa:16:3e:89:99:e2", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2281cf92-6c", "ovs_interfaceid": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converting VIF {"id": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "address": "fa:16:3e:89:99:e2", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2281cf92-6c", "ovs_interfaceid": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:e2,bridge_name='br-int',has_traffic_filtering=True,id=2281cf92-6cc5-41e7-965f-b6daaa5fcd20,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2281cf92-6c') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG os_vif [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:e2,bridge_name='br-int',has_traffic_filtering=True,id=2281cf92-6cc5-41e7-965f-b6daaa5fcd20,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2281cf92-6c') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0f3406b-d901-56d5-b8d5-c7bcea3cd1cb', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2281cf92-6c, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2281cf92-6c, col_values=(('qos', UUID('15553049-45d9-4f9a-974a-f1c02077c140')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2281cf92-6c, col_values=(('external_ids', {'iface-id': '2281cf92-6cc5-41e7-965f-b6daaa5fcd20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:99:e2', 'vm-uuid': '07fdb716-7ff0-4a70-b084-ddeb23f0fb9b'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:43 user nova-compute[74963]: INFO os_vif [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:e2,bridge_name='br-int',has_traffic_filtering=True,id=2281cf92-6cc5-41e7-965f-b6daaa5fcd20,network=Network(a15014d6-4113-4a03-926b-9f2fb8d987e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2281cf92-6c')
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:38:43 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] No VIF found with MAC fa:16:3e:89:99:e2, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG nova.network.neutron [req-011e180a-d566-42ec-a3d6-e90debebb450 req-72a13a2d-8d14-4edd-bff8-bcfd3b4dc73e service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Updated VIF entry in instance network info cache for port 2281cf92-6cc5-41e7-965f-b6daaa5fcd20. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG nova.network.neutron [req-011e180a-d566-42ec-a3d6-e90debebb450 req-72a13a2d-8d14-4edd-bff8-bcfd3b4dc73e service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Updating instance_info_cache with network_info: [{"id": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "address": "fa:16:3e:89:99:e2", "network": {"id": "a15014d6-4113-4a03-926b-9f2fb8d987e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1798946969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36c9009714354721a7697c14258ffc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2281cf92-6c", "ovs_interfaceid": "2281cf92-6cc5-41e7-965f-b6daaa5fcd20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-011e180a-d566-42ec-a3d6-e90debebb450 req-72a13a2d-8d14-4edd-bff8-bcfd3b4dc73e service nova] Releasing lock "refresh_cache-07fdb716-7ff0-4a70-b084-ddeb23f0fb9b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:44 user nova-compute[74963]: INFO nova.compute.manager [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Terminating instance
Nov 30 08:38:44 user nova-compute[74963]: DEBUG nova.compute.manager [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-bc4feb64-e1bc-4132-a0e8-2687c80e4977 req-49c105af-621c-47e1-a905-a66454f46e2d service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-unplugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bc4feb64-e1bc-4132-a0e8-2687c80e4977 req-49c105af-621c-47e1-a905-a66454f46e2d service nova] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bc4feb64-e1bc-4132-a0e8-2687c80e4977 req-49c105af-621c-47e1-a905-a66454f46e2d service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-bc4feb64-e1bc-4132-a0e8-2687c80e4977 req-49c105af-621c-47e1-a905-a66454f46e2d service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-bc4feb64-e1bc-4132-a0e8-2687c80e4977 req-49c105af-621c-47e1-a905-a66454f46e2d service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] No waiting events found dispatching network-vif-unplugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:38:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-bc4feb64-e1bc-4132-a0e8-2687c80e4977 req-49c105af-621c-47e1-a905-a66454f46e2d service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-unplugged-d971edba-1059-4e1c-a701-aee51ab5cd59 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-7975b2b7-54c3-486b-b44c-45ffa4336d79 req-ef0d6330-1b6b-4357-965e-fd101bc8096e service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Received event network-vif-plugged-2281cf92-6cc5-41e7-965f-b6daaa5fcd20 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7975b2b7-54c3-486b-b44c-45ffa4336d79 req-ef0d6330-1b6b-4357-965e-fd101bc8096e service nova] Acquiring lock "07fdb716-7ff0-4a70-b084-ddeb23f0fb9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7975b2b7-54c3-486b-b44c-45ffa4336d79 req-ef0d6330-1b6b-4357-965e-fd101bc8096e service nova] Lock "07fdb716-7ff0-4a70-b084-ddeb23f0fb9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-7975b2b7-54c3-486b-b44c-45ffa4336d79 req-ef0d6330-1b6b-4357-965e-fd101bc8096e service nova] Lock "07fdb716-7ff0-4a70-b084-ddeb23f0fb9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-7975b2b7-54c3-486b-b44c-45ffa4336d79 req-ef0d6330-1b6b-4357-965e-fd101bc8096e service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] No waiting events found dispatching network-vif-plugged-2281cf92-6cc5-41e7-965f-b6daaa5fcd20 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:38:45 user nova-compute[74963]: WARNING nova.compute.manager [req-7975b2b7-54c3-486b-b44c-45ffa4336d79 req-ef0d6330-1b6b-4357-965e-fd101bc8096e service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Received unexpected event network-vif-plugged-2281cf92-6cc5-41e7-965f-b6daaa5fcd20 for instance with vm_state building and task_state spawning.
Nov 30 08:38:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Instance destroyed successfully.
Nov 30 08:38:45 user nova-compute[74963]: DEBUG nova.objects.instance [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'resources' on Instance uuid 852f07b2-063c-4225-ba5d-2aa8fd25ea5c {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-350375214',display_name='tempest-TestMinimumBasicScenario-server-350375214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-350375214',id=41,image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNTMdTZqGdn5fGGpuwmipL8JAwunkj6tNUcOg3KCk39VwIlTZ5bPaPdjgX29N8YB3Kn8ib9NsNjsSE3qN3tlCeA2Alp233wU5LJH2Ce5RAQobujjVxxwOiWHItwL02og==',key_name='tempest-TestMinimumBasicScenario-1406737130',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:33:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a4df22008114c12b02eff15a5b3c228',ramdisk_id='',reservation_id='r-jj18c6oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='438ac9a9-7c77-4030-b963-c9bb079ae8fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-171021974',owner_user_name='tempest-TestMinimumBasicScenario-171021974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:36:04Z,user_data=None,user_id='c6ad4469500b4c01a5ddf6bf2208e955',uuid=852f07b2-063c-4225-ba5d-2aa8fd25ea5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converting VIF {"id": "d971edba-1059-4e1c-a701-aee51ab5cd59", "address": "fa:16:3e:27:b5:61", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971edba-10", "ovs_interfaceid": "d971edba-1059-4e1c-a701-aee51ab5cd59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG os_vif [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd971edba-10, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=baff6ffb-646b-40c1-9202-0a68c65bd829) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:45 user nova-compute[74963]: INFO os_vif [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=d971edba-1059-4e1c-a701-aee51ab5cd59,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971edba-10')
Nov 30 08:38:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Deleting instance files /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c_del
Nov 30 08:38:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Deletion of /opt/stack/data/nova/instances/852f07b2-063c-4225-ba5d-2aa8fd25ea5c_del complete
Nov 30 08:38:45 user nova-compute[74963]: INFO nova.compute.manager [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 30 08:38:45 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:38:45 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:38:46 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:38:46 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Took 0.41 seconds to deallocate network for instance.
Nov 30 08:38:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-dac9c00c-e136-43b7-bc48-b0782e948177 req-7f922e76-a871-42cc-86b4-535ea92a4d55 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-deleted-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:46 user nova-compute[74963]: INFO nova.compute.manager [req-dac9c00c-e136-43b7-bc48-b0782e948177 req-7f922e76-a871-42cc-86b4-535ea92a4d55 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Neutron deleted interface d971edba-1059-4e1c-a701-aee51ab5cd59; detaching it from the instance and deleting it from the info cache
Nov 30 08:38:46 user nova-compute[74963]: DEBUG nova.network.neutron [req-dac9c00c-e136-43b7-bc48-b0782e948177 req-7f922e76-a871-42cc-86b4-535ea92a4d55 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:38:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-dac9c00c-e136-43b7-bc48-b0782e948177 req-7f922e76-a871-42cc-86b4-535ea92a4d55 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Detach interface failed, port_id=d971edba-1059-4e1c-a701-aee51ab5cd59, reason: Instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c could not be found. {{(pid=74963) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 08:38:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:46 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:38:46 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:38:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:46 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Deleted allocations for instance 852f07b2-063c-4225-ba5d-2aa8fd25ea5c
Nov 30 08:38:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-665b7f3d-51c1-46db-9fd6-822ba3b7921c tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.078s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-d87cdc83-4d57-4de6-b898-8f3cec021c18 req-0306ef3c-5f55-4c2a-a7ca-6fcfa82a5670 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d87cdc83-4d57-4de6-b898-8f3cec021c18 req-0306ef3c-5f55-4c2a-a7ca-6fcfa82a5670 service nova] Acquiring lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d87cdc83-4d57-4de6-b898-8f3cec021c18 req-0306ef3c-5f55-4c2a-a7ca-6fcfa82a5670 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d87cdc83-4d57-4de6-b898-8f3cec021c18 req-0306ef3c-5f55-4c2a-a7ca-6fcfa82a5670 service nova] Lock "852f07b2-063c-4225-ba5d-2aa8fd25ea5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-d87cdc83-4d57-4de6-b898-8f3cec021c18 req-0306ef3c-5f55-4c2a-a7ca-6fcfa82a5670 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] No waiting events found dispatching network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:38:47 user nova-compute[74963]: WARNING nova.compute.manager [req-d87cdc83-4d57-4de6-b898-8f3cec021c18 req-0306ef3c-5f55-4c2a-a7ca-6fcfa82a5670 service nova] [instance: 852f07b2-063c-4225-ba5d-2aa8fd25ea5c] Received unexpected event network-vif-plugged-d971edba-1059-4e1c-a701-aee51ab5cd59 for instance with vm_state deleted and task_state None.
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-ba1d8657-c292-4b57-bde9-2b448e75ed50 req-42d7733b-2a3c-4825-8124-c326128b5ae9 service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Received event network-vif-plugged-2281cf92-6cc5-41e7-965f-b6daaa5fcd20 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ba1d8657-c292-4b57-bde9-2b448e75ed50 req-42d7733b-2a3c-4825-8124-c326128b5ae9 service nova] Acquiring lock "07fdb716-7ff0-4a70-b084-ddeb23f0fb9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ba1d8657-c292-4b57-bde9-2b448e75ed50 req-42d7733b-2a3c-4825-8124-c326128b5ae9 service nova] Lock "07fdb716-7ff0-4a70-b084-ddeb23f0fb9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-ba1d8657-c292-4b57-bde9-2b448e75ed50 req-42d7733b-2a3c-4825-8124-c326128b5ae9 service nova] Lock "07fdb716-7ff0-4a70-b084-ddeb23f0fb9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.compute.manager [req-ba1d8657-c292-4b57-bde9-2b448e75ed50 req-42d7733b-2a3c-4825-8124-c326128b5ae9 service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] No waiting events found dispatching network-vif-plugged-2281cf92-6cc5-41e7-965f-b6daaa5fcd20 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:38:47 user nova-compute[74963]: WARNING nova.compute.manager [req-ba1d8657-c292-4b57-bde9-2b448e75ed50 req-42d7733b-2a3c-4825-8124-c326128b5ae9 service nova] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Received unexpected event network-vif-plugged-2281cf92-6cc5-41e7-965f-b6daaa5fcd20 for instance with vm_state building and task_state spawning.
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:38:47 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Instance spawned successfully.
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:38:47 user nova-compute[74963]: INFO nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 30 08:38:47 user nova-compute[74963]: DEBUG nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:38:47 user nova-compute[74963]: INFO nova.compute.manager [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] [instance: 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b] Took 6.71 seconds to build instance.
Nov 30 08:38:47 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-41306c7b-b499-48e7-b682-280382eda2a3 tempest-AttachVolumeShelveTestJSON-1943160204 tempest-AttachVolumeShelveTestJSON-1943160204-project-member] Lock "07fdb716-7ff0-4a70-b084-ddeb23f0fb9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.823s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG nova.objects.instance [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'flavor' on Instance uuid 6ff2c759-df48-48af-aa22-b11ba470deea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:38:48 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Ignoring supplied device name: /dev/vdb
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:38:48 user nova-compute[74963]: INFO nova.compute.manager [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Attaching volume ad1b0874-4e92-45ae-9a4c-855315a49ca2 to /dev/vdb
Nov 30 08:38:48 user nova-compute[74963]: DEBUG os_brick.utils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2278a6c1-2c61-4f48-bd7e-4e7b665ae6cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-052d6b80-22a8-49f6-9940-e8b938d7ab29 req-e27cb10c-5c48-4c83-ae84-ee97d366c6db service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received event network-changed-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG nova.compute.manager [req-052d6b80-22a8-49f6-9940-e8b938d7ab29 req-e27cb10c-5c48-4c83-ae84-ee97d366c6db service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Refreshing instance network info cache due to event network-changed-a857b32e-312b-41cb-902f-82d90fe44d70. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-052d6b80-22a8-49f6-9940-e8b938d7ab29 req-e27cb10c-5c48-4c83-ae84-ee97d366c6db service nova] Acquiring lock "refresh_cache-6ff2c759-df48-48af-aa22-b11ba470deea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-052d6b80-22a8-49f6-9940-e8b938d7ab29 req-e27cb10c-5c48-4c83-ae84-ee97d366c6db service nova] Acquired lock "refresh_cache-6ff2c759-df48-48af-aa22-b11ba470deea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG nova.network.neutron [req-052d6b80-22a8-49f6-9940-e8b938d7ab29 req-e27cb10c-5c48-4c83-ae84-ee97d366c6db service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Refreshing network info cache for port a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee2ddf4-aba9-4e76-bce6-f11a93b9dbe9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f000e5-9b87-43af-8dad-c7801a6493ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[11325a83-5fff-447f-98cc-c2af923fc3ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:38:48 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84bc558-1072-491b-9e97-cda98d7b4156]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG os_brick.utils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Updating existing volume attachment record: ed947998-fbf7-4c58-89a6-9c603b5bc3b6 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG nova.network.neutron [req-052d6b80-22a8-49f6-9940-e8b938d7ab29 req-e27cb10c-5c48-4c83-ae84-ee97d366c6db service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Updated VIF entry in instance network info cache for port a857b32e-312b-41cb-902f-82d90fe44d70. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG nova.network.neutron [req-052d6b80-22a8-49f6-9940-e8b938d7ab29 req-e27cb10c-5c48-4c83-ae84-ee97d366c6db service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Updating instance_info_cache with network_info: [{"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:38:48 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-052d6b80-22a8-49f6-9940-e8b938d7ab29 req-e27cb10c-5c48-4c83-ae84-ee97d366c6db service nova] Releasing lock "refresh_cache-6ff2c759-df48-48af-aa22-b11ba470deea" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:38:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YpnrjeuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:38:57 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:38:57 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:38:57 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18b0402-13d9-4c17-bbdc-a5ced46dda00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:38:57 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.120s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1778add2-e25a-4be2-8c59-39b7ffc28322]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2] added
Nov 30 08:38:57 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[09731bc9-0b82-4924-bac1-6b24a7743625]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb2b283-279a-4ff5-9a47-968373968db9]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YpnrjeuK {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YpnrjeuK" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bac54b-44e9-44ee-98dd-47caada6f8e4]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YpnrjeuK'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[187a966d-099d-4272-a2be-a289c92ea1ed]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ad9c25-4a25-43bc-b6e1-5d5d73d352fc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:57 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:38:57 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:57 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:38:57 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d51c61-5a89-461b-91b1-1b97651a4fd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2, portal: 172.16.0.220,3260]
Nov 30 08:38:57 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2, portal: 172.16.0.220,3260] successful.
Nov 30 08:38:57 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e9cb8-a3cd-4a99-9720-2f4631fe8d92]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[432cfacb-696a-45d7-97f2-f0dfeb5b767f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:57 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:38:57 user nova-compute[74963]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)
Nov 30 08:38:57 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:38:57 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:38:57 user nova-compute[74963]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)
Nov 30 08:38:57 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0f2381-df41-4c39-ba69-65f386918bbe]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:38:57 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YpnrjeuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:38:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:38:58 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23736623465643537', 'path': '/dev/sdd'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:38:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736623465643537', 'path': '/dev/sdd'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:38:58 user nova-compute[74963]: DEBUG nova.objects.instance [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'flavor' on Instance uuid 6ff2c759-df48-48af-aa22-b11ba470deea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:38:58 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:38:58 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:38:58 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:38:58 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:38:58 user nova-compute[74963]:   <serial>ad1b0874-4e92-45ae-9a4c-855315a49ca2</serial>
Nov 30 08:38:58 user nova-compute[74963]: </disk>
Nov 30 08:38:58 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:38:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:38:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:38:59 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] No VIF found with MAC fa:16:3e:fd:0d:15, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:38:59 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-12377285-04f6-4dd0-94e5-0c7b07d96588 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.931s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:38:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:10 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:11 user nova-compute[74963]: DEBUG nova.compute.manager [req-94ea0173-1c1c-4487-9c03-c6eba729122e req-30a238ae-af0e-4f9c-9234-5ff695a2d4f9 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Received event network-changed-2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:11 user nova-compute[74963]: DEBUG nova.compute.manager [req-94ea0173-1c1c-4487-9c03-c6eba729122e req-30a238ae-af0e-4f9c-9234-5ff695a2d4f9 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Refreshing instance network info cache due to event network-changed-2db46775-eab2-4fb8-bab4-4011a1e47968. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:39:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-94ea0173-1c1c-4487-9c03-c6eba729122e req-30a238ae-af0e-4f9c-9234-5ff695a2d4f9 service nova] Acquiring lock "refresh_cache-b3273f7d-7427-443e-bd17-ab4fb74e61d1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:39:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-94ea0173-1c1c-4487-9c03-c6eba729122e req-30a238ae-af0e-4f9c-9234-5ff695a2d4f9 service nova] Acquired lock "refresh_cache-b3273f7d-7427-443e-bd17-ab4fb74e61d1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:39:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-94ea0173-1c1c-4487-9c03-c6eba729122e req-30a238ae-af0e-4f9c-9234-5ff695a2d4f9 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Refreshing network info cache for port 2db46775-eab2-4fb8-bab4-4011a1e47968 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:39:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-94ea0173-1c1c-4487-9c03-c6eba729122e req-30a238ae-af0e-4f9c-9234-5ff695a2d4f9 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Updated VIF entry in instance network info cache for port 2db46775-eab2-4fb8-bab4-4011a1e47968. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:39:11 user nova-compute[74963]: DEBUG nova.network.neutron [req-94ea0173-1c1c-4487-9c03-c6eba729122e req-30a238ae-af0e-4f9c-9234-5ff695a2d4f9 service nova] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Updating instance_info_cache with network_info: [{"id": "2db46775-eab2-4fb8-bab4-4011a1e47968", "address": "fa:16:3e:40:f1:b9", "network": {"id": "9f0c33ea-12b5-4737-8622-4e01c5af5ef3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1037339050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2164e77b2f554d9b8eecac876545849b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db46775-ea", "ovs_interfaceid": "2db46775-eab2-4fb8-bab4-4011a1e47968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:39:11 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-94ea0173-1c1c-4487-9c03-c6eba729122e req-30a238ae-af0e-4f9c-9234-5ff695a2d4f9 service nova] Releasing lock "refresh_cache-b3273f7d-7427-443e-bd17-ab4fb74e61d1" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:39:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:13 user nova-compute[74963]: DEBUG nova.objects.instance [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'flavor' on Instance uuid b3273f7d-7427-443e-bd17-ab4fb74e61d1 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:39:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:13 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:13 user nova-compute[74963]: INFO nova.compute.manager [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Attaching volume f47dd89f-5aa0-4e61-94cb-db411c678d60 to /dev/vdb
Nov 30 08:39:13 user nova-compute[74963]: DEBUG os_brick.utils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:39:13 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2518ef1-a00b-4c43-ab63-a4640116d154]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7bad5c60b7dd\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0163cd73-806b-4f09-812a-cd0efdf352cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3336cdb6-354e-4591-b2d4-39d597dbb896]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8d807-f9b5-4a88-abbb-1525d962c262]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Running cmd (subprocess): nvme version {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] 'nvme version' failed. Not Retrying. {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.nvmeof [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] nvme not present on system {{(pid=74963) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 08:39:14 user nova-compute[74963]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 08:39:14 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c186d57-3f19-4113-9a62-ee0092f3dce7]: (4, '') {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74963) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.lightos [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] LIGHTOS: no hostnqn found. {{(pid=74963) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG os_brick.utils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7bad5c60b7dd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG nova.virt.block_device [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Updating existing volume attachment record: f9a19444-bf49-470a-bed6-5f4536f28f80 {{(pid=74963) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 08:39:14 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:15 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:19 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:20 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:21 user nova-compute[74963]: INFO nova.compute.manager [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Detaching volume ad1b0874-4e92-45ae-9a4c-855315a49ca2
Nov 30 08:39:21 user nova-compute[74963]: INFO nova.virt.block_device [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Attempting to driver detach volume ad1b0874-4e92-45ae-9a4c-855315a49ca2 from mountpoint /dev/vdb
Nov 30 08:39:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Attempting to detach device vdb from instance 6ff2c759-df48-48af-aa22-b11ba470deea from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:39:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:39:21 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:39:21 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:39:21 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:39:21 user nova-compute[74963]:   <serial>ad1b0874-4e92-45ae-9a4c-855315a49ca2</serial>
Nov 30 08:39:21 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:39:21 user nova-compute[74963]: </disk>
Nov 30 08:39:21 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:39:21 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Successfully detached device vdb from instance 6ff2c759-df48-48af-aa22-b11ba470deea from the persistent domain config.
Nov 30 08:39:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ff2c759-df48-48af-aa22-b11ba470deea from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:39:21 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:39:21 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:39:21 user nova-compute[74963]:   <source dev="/dev/sdd"/>
Nov 30 08:39:21 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:39:21 user nova-compute[74963]:   <serial>ad1b0874-4e92-45ae-9a4c-855315a49ca2</serial>
Nov 30 08:39:21 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:39:21 user nova-compute[74963]: </disk>
Nov 30 08:39:21 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:39:21 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ff2c759-df48-48af-aa22-b11ba470deea {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Calling os-brick to attach iSCSI Volume {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpLWSRzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:39:22 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:39:22 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:39:22 user nova-compute[74963]: INFO os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ff5320-da22-498d-9901-70a0bb82cff1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 08:39:22 user nova-compute[74963]:  {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --interface default --op new {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcdaff0-dc99-43a1-b8db-8bbb90bcd797]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60] added\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60] added
Nov 30 08:39:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d170146-fc13-40f3-85b9-e9ac6ddee4b1]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b22507-623c-4774-aaaa-1fbe1e0cfc36]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpLWSRzm {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpLWSRzm" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab90b7c2-817f-43ae-af41-7413919af890]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hpLWSRzm'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a52b0-94a1-4ebc-8bb5-7c240b057bd2]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cec46f-cac7-4a05-ac13-b9939c4d7dd4]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:22 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:22 user nova-compute[74963]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)
Nov 30 08:39:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:22 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:22 user nova-compute[74963]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)
Nov 30 08:39:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --login {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[032130bc-3bf8-4706-a262-d58ee7d0a894]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60, portal: 172.16.0.220,3260]
Nov 30 08:39:22 user nova-compute[74963]: Login to [iface: default, target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60, portal: 172.16.0.220,3260] successful.
Nov 30 08:39:22 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:22 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8357bf6d-e17e-4031-b245-99d5e45f6f15]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c954d-8739-4c2c-8402-660dd9e45cd1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:23 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:23 user nova-compute[74963]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)
Nov 30 08:39:23 user nova-compute[74963]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)
Nov 30 08:39:23 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:23 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:23 user nova-compute[74963]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)
Nov 30 08:39:23 user nova-compute[74963]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)
Nov 30 08:39:23 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Connected to 172.16.0.220:3260 {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=74963) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74963) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d3d92-34cc-4b39-9342-0cc73b7d83be]: (4, ('- - 0', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74963) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 08:39:23 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpLWSRzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74963) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Starting heal instance info cache {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26537376561323032', 'path': '/dev/sde'} {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537376561323032', 'path': '/dev/sde'} {{(pid=74963) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.objects.instance [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'flavor' on Instance uuid b3273f7d-7427-443e-bd17-ab4fb74e61d1 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 08:39:24 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:39:24 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:39:24 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:39:24 user nova-compute[74963]:   <serial>f47dd89f-5aa0-4e61-94cb-db411c678d60</serial>
Nov 30 08:39:24 user nova-compute[74963]: </disk>
Nov 30 08:39:24 user nova-compute[74963]:  {{(pid=74963) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquired lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Forcefully refreshing network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] No VIF found with MAC fa:16:3e:40:f1:b9, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.network.neutron [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Updating instance_info_cache with network_info: [{"id": "99bb881b-5044-41a4-bda0-d7dd511658e9", "address": "fa:16:3e:3b:a9:6c", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb881b-50", "ovs_interfaceid": "99bb881b-5044-41a4-bda0-d7dd511658e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Releasing lock "refresh_cache-1823711f-c16f-4200-a689-994e79c330a5" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] [instance: 1823711f-c16f-4200-a689-994e79c330a5] Updated the network info_cache for instance {{(pid=74963) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 08:39:24 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-799a690d-ab9c-4f32-961b-046f68a568e6 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.718s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:25 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:39:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:25 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:25 user nova-compute[74963]: INFO nova.compute.manager [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Detaching volume f47dd89f-5aa0-4e61-94cb-db411c678d60
Nov 30 08:39:25 user nova-compute[74963]: INFO nova.virt.block_device [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Attempting to driver detach volume f47dd89f-5aa0-4e61-94cb-db411c678d60 from mountpoint /dev/vdb
Nov 30 08:39:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Attempting to detach device vdb from instance b3273f7d-7427-443e-bd17-ab4fb74e61d1 from the persistent domain config. {{(pid=74963) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 08:39:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:39:25 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:39:25 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:39:25 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:39:25 user nova-compute[74963]:   <serial>f47dd89f-5aa0-4e61-94cb-db411c678d60</serial>
Nov 30 08:39:25 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:39:25 user nova-compute[74963]: </disk>
Nov 30 08:39:25 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:39:25 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully detached device vdb from instance b3273f7d-7427-443e-bd17-ab4fb74e61d1 from the persistent domain config.
Nov 30 08:39:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3273f7d-7427-443e-bd17-ab4fb74e61d1 from the live domain config. {{(pid=74963) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 08:39:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.guest [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 08:39:25 user nova-compute[74963]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 08:39:25 user nova-compute[74963]:   <source dev="/dev/sde"/>
Nov 30 08:39:25 user nova-compute[74963]:   <target dev="vdb" bus="virtio"/>
Nov 30 08:39:25 user nova-compute[74963]:   <serial>f47dd89f-5aa0-4e61-94cb-db411c678d60</serial>
Nov 30 08:39:25 user nova-compute[74963]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 08:39:25 user nova-compute[74963]: </disk>
Nov 30 08:39:25 user nova-compute[74963]:  {{(pid=74963) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 08:39:25 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3273f7d-7427-443e-bd17-ab4fb74e61d1 {{(pid=74963) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 08:39:25 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74963) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fdb716-7ff0-4a70-b084-ddeb23f0fb9b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:26 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3273f7d-7427-443e-bd17-ab4fb74e61d1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74963) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 08:39:27 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:39:27 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Hypervisor/Node resource view: name=user free_ram=8314MB free_disk=25.11343002319336GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74963) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 1823711f-c16f-4200-a689-994e79c330a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 6ff2c759-df48-48af-aa22-b11ba470deea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance b3273f7d-7427-443e-bd17-ab4fb74e61d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 41d8b782-5b70-48bf-9489-fca44341eff7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Instance 07fdb716-7ff0-4a70-b084-ddeb23f0fb9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74963) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 08:39:27 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74963) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 08:39:28 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:39:28 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:39:28 user nova-compute[74963]: DEBUG nova.compute.resource_tracker [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Compute_service record updated for user:user {{(pid=74963) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 08:39:28 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:39:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:39:29 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:39:29 user nova-compute[74963]: DEBUG nova.compute.manager [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74963) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 08:39:29 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:30 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:39:30 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:33 user nova-compute[74963]: DEBUG oslo_service.periodic_task [None req-58e01314-a39f-4e4a-8702-295cd9c210e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74963) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 08:39:35 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "39358f4b-567d-4e7a-b5d4-aac14df3794b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "39358f4b-567d-4e7a-b5d4-aac14df3794b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Starting instance... {{(pid=74963) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74963) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 08:39:38 user nova-compute[74963]: INFO nova.compute.claims [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Claim successful on node user
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Start building networks asynchronously for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Allocating IP information in the background. {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] allocate_for_instance() {{(pid=74963) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 08:39:38 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Start building block device mappings for instance. {{(pid=74963) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.policy [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6ad4469500b4c01a5ddf6bf2208e955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4df22008114c12b02eff15a5b3c228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74963) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Start spawning the instance on the hypervisor. {{(pid=74963) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Creating instance directory {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 08:39:38 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Creating image(s)
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "/opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "/opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "/opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "2f71671a10ad30ea3b76e37fc500b7e7a6fd3666" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:38 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "2f71671a10ad30ea3b76e37fc500b7e7a6fd3666" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666.part --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:39 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666.part --force-share --output=json" returned: 0 in 0.280s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:39 user nova-compute[74963]: DEBUG nova.virt.images [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] d2f74598-5e68-40dd-868a-fda52a263308 was qcow2, converting to raw {{(pid=74963) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 08:39:39 user nova-compute[74963]: DEBUG nova.privsep.utils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74963) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 08:39:39 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666.part /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666.converted {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:39 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Successfully created port: 2a2b36cb-9883-4681-8f99-09a343a02222 {{(pid=74963) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666.part /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666.converted" returned: 0 in 0.603s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666.converted --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "2f71671a10ad30ea3b76e37fc500b7e7a6fd3666" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.486s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Successfully updated port: 2a2b36cb-9883-4681-8f99-09a343a02222 {{(pid=74963) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-4443da3c-8249-46d9-8182-51d42e9ba647 req-a91ab23a-92d6-44fa-9028-adb5251ee525 service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Received event network-changed-2a2b36cb-9883-4681-8f99-09a343a02222 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG nova.compute.manager [req-4443da3c-8249-46d9-8182-51d42e9ba647 req-a91ab23a-92d6-44fa-9028-adb5251ee525 service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Refreshing instance network info cache due to event network-changed-2a2b36cb-9883-4681-8f99-09a343a02222. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4443da3c-8249-46d9-8182-51d42e9ba647 req-a91ab23a-92d6-44fa-9028-adb5251ee525 service nova] Acquiring lock "refresh_cache-39358f4b-567d-4e7a-b5d4-aac14df3794b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4443da3c-8249-46d9-8182-51d42e9ba647 req-a91ab23a-92d6-44fa-9028-adb5251ee525 service nova] Acquired lock "refresh_cache-39358f4b-567d-4e7a-b5d4-aac14df3794b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG nova.network.neutron [req-4443da3c-8249-46d9-8182-51d42e9ba647 req-a91ab23a-92d6-44fa-9028-adb5251ee525 service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Refreshing network info cache for port 2a2b36cb-9883-4681-8f99-09a343a02222 {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "refresh_cache-39358f4b-567d-4e7a-b5d4-aac14df3794b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666 --force-share --output=json" returned: 0 in 0.181s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "2f71671a10ad30ea3b76e37fc500b7e7a6fd3666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "2f71671a10ad30ea3b76e37fc500b7e7a6fd3666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG nova.network.neutron [req-4443da3c-8249-46d9-8182-51d42e9ba647 req-a91ab23a-92d6-44fa-9028-adb5251ee525 service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666 --force-share --output=json" returned: 0 in 0.196s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666,backing_fmt=raw /opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk 1073741824 {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666,backing_fmt=raw /opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk 1073741824" returned: 0 in 0.050s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "2f71671a10ad30ea3b76e37fc500b7e7a6fd3666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666 --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG nova.network.neutron [req-4443da3c-8249-46d9-8182-51d42e9ba647 req-a91ab23a-92d6-44fa-9028-adb5251ee525 service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-4443da3c-8249-46d9-8182-51d42e9ba647 req-a91ab23a-92d6-44fa-9028-adb5251ee525 service nova] Releasing lock "refresh_cache-39358f4b-567d-4e7a-b5d4-aac14df3794b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquired lock "refresh_cache-39358f4b-567d-4e7a-b5d4-aac14df3794b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Building network info cache for instance {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f71671a10ad30ea3b76e37fc500b7e7a6fd3666 --force-share --output=json" returned: 0 in 0.176s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk. size=1073741824 {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 08:39:40 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk --force-share --output=json {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.disk.api [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Cannot resize image /opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk to a smaller size. {{(pid=74963) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Created local disks {{(pid=74963) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Ensure instance console log exists: /opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/console.log {{(pid=74963) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Instance cache missing network info. {{(pid=74963) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.network.neutron [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Updating instance_info_cache with network_info: [{"id": "2a2b36cb-9883-4681-8f99-09a343a02222", "address": "fa:16:3e:19:af:2f", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2b36cb-98", "ovs_interfaceid": "2a2b36cb-9883-4681-8f99-09a343a02222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Releasing lock "refresh_cache-39358f4b-567d-4e7a-b5d4-aac14df3794b" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Instance network_info: |[{"id": "2a2b36cb-9883-4681-8f99-09a343a02222", "address": "fa:16:3e:19:af:2f", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2b36cb-98", "ovs_interfaceid": "2a2b36cb-9883-4681-8f99-09a343a02222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74963) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Start _get_guest_xml network_info=[{"id": "2a2b36cb-9883-4681-8f99-09a343a02222", "address": "fa:16:3e:19:af:2f", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2b36cb-98", "ovs_interfaceid": "2a2b36cb-9883-4681-8f99-09a343a02222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:39:36Z,direct_url=<?>,disk_format='qcow2',id=d2f74598-5e68-40dd-868a-fda52a263308,min_disk=0,min_ram=0,name='tempest-scenario-img--611383423',owner='3a4df22008114c12b02eff15a5b3c228',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:39:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'image_id': 'd2f74598-5e68-40dd-868a-fda52a263308'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 08:39:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:39:41 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CPU controller missing on host. {{(pid=74963) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.host [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CPU controller found on host. {{(pid=74963) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74963) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T08:02:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T08:39:36Z,direct_url=<?>,disk_format='qcow2',id=d2f74598-5e68-40dd-868a-fda52a263308,min_disk=0,min_ram=0,name='tempest-scenario-img--611383423',owner='3a4df22008114c12b02eff15a5b3c228',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T08:39:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Flavor limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Image limits 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Flavor pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Image pref 0:0:0 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Got 1 possible topologies {{(pid=74963) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.hardware [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74963) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2066934095',display_name='tempest-TestMinimumBasicScenario-server-2066934095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2066934095',id=47,image_ref='d2f74598-5e68-40dd-868a-fda52a263308',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8anSMqzswPaAqpKrt3ZnDkK1cAKBT72sIZwSKgmLO5BY5FAk0r0toUAROqTex8ACpmj9LmD+WRNZ+tz76XrnJKgdKxy2CBenXwGpqm4v/sPGKM9jf+QJ0LFwz0Xs5+KA==',key_name='tempest-TestMinimumBasicScenario-1131826780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a4df22008114c12b02eff15a5b3c228',ramdisk_id='',reservation_id='r-aby0hcbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d2f74598-5e68-40dd-868a-fda52a263308',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-171021974',owner_user_name='tempest-TestMinimumBasicScenario-171021974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:39:39Z,user_data=None,user_id='c6ad4469500b4c01a5ddf6bf2208e955',uuid=39358f4b-567d-4e7a-b5d4-aac14df3794b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a2b36cb-9883-4681-8f99-09a343a02222", "address": "fa:16:3e:19:af:2f", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2b36cb-98", "ovs_interfaceid": "2a2b36cb-9883-4681-8f99-09a343a02222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74963) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converting VIF {"id": "2a2b36cb-9883-4681-8f99-09a343a02222", "address": "fa:16:3e:19:af:2f", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2b36cb-98", "ovs_interfaceid": "2a2b36cb-9883-4681-8f99-09a343a02222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:af:2f,bridge_name='br-int',has_traffic_filtering=True,id=2a2b36cb-9883-4681-8f99-09a343a02222,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2b36cb-98') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.objects.instance [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lazy-loading 'pci_devices' on Instance uuid 39358f4b-567d-4e7a-b5d4-aac14df3794b {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 08:39:41 user nova-compute[74963]:   <uuid>39358f4b-567d-4e7a-b5d4-aac14df3794b</uuid>
Nov 30 08:39:41 user nova-compute[74963]:   <name>instance-0000002f</name>
Nov 30 08:39:41 user nova-compute[74963]:   <memory>524288</memory>
Nov 30 08:39:41 user nova-compute[74963]:   <vcpu>1</vcpu>
Nov 30 08:39:41 user nova-compute[74963]:   <metadata>
Nov 30 08:39:41 user nova-compute[74963]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 08:39:41 user nova-compute[74963]:       <nova:package version="0.0.0"/>
Nov 30 08:39:41 user nova-compute[74963]:       <nova:name>tempest-TestMinimumBasicScenario-server-2066934095</nova:name>
Nov 30 08:39:41 user nova-compute[74963]:       <nova:creationTime>2023-11-30 08:39:41</nova:creationTime>
Nov 30 08:39:41 user nova-compute[74963]:       <nova:flavor name="m1.tiny">
Nov 30 08:39:41 user nova-compute[74963]:         <nova:memory>512</nova:memory>
Nov 30 08:39:41 user nova-compute[74963]:         <nova:disk>1</nova:disk>
Nov 30 08:39:41 user nova-compute[74963]:         <nova:swap>0</nova:swap>
Nov 30 08:39:41 user nova-compute[74963]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 08:39:41 user nova-compute[74963]:         <nova:vcpus>1</nova:vcpus>
Nov 30 08:39:41 user nova-compute[74963]:       </nova:flavor>
Nov 30 08:39:41 user nova-compute[74963]:       <nova:owner>
Nov 30 08:39:41 user nova-compute[74963]:         <nova:user uuid="c6ad4469500b4c01a5ddf6bf2208e955">tempest-TestMinimumBasicScenario-171021974-project-member</nova:user>
Nov 30 08:39:41 user nova-compute[74963]:         <nova:project uuid="3a4df22008114c12b02eff15a5b3c228">tempest-TestMinimumBasicScenario-171021974</nova:project>
Nov 30 08:39:41 user nova-compute[74963]:       </nova:owner>
Nov 30 08:39:41 user nova-compute[74963]:       <nova:root type="image" uuid="d2f74598-5e68-40dd-868a-fda52a263308"/>
Nov 30 08:39:41 user nova-compute[74963]:       <nova:ports>
Nov 30 08:39:41 user nova-compute[74963]:         <nova:port uuid="2a2b36cb-9883-4681-8f99-09a343a02222">
Nov 30 08:39:41 user nova-compute[74963]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 08:39:41 user nova-compute[74963]:         </nova:port>
Nov 30 08:39:41 user nova-compute[74963]:       </nova:ports>
Nov 30 08:39:41 user nova-compute[74963]:     </nova:instance>
Nov 30 08:39:41 user nova-compute[74963]:   </metadata>
Nov 30 08:39:41 user nova-compute[74963]:   <sysinfo type="smbios">
Nov 30 08:39:41 user nova-compute[74963]:     <system>
Nov 30 08:39:41 user nova-compute[74963]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 08:39:41 user nova-compute[74963]:       <entry name="product">OpenStack Nova</entry>
Nov 30 08:39:41 user nova-compute[74963]:       <entry name="version">0.0.0</entry>
Nov 30 08:39:41 user nova-compute[74963]:       <entry name="serial">39358f4b-567d-4e7a-b5d4-aac14df3794b</entry>
Nov 30 08:39:41 user nova-compute[74963]:       <entry name="uuid">39358f4b-567d-4e7a-b5d4-aac14df3794b</entry>
Nov 30 08:39:41 user nova-compute[74963]:       <entry name="family">Virtual Machine</entry>
Nov 30 08:39:41 user nova-compute[74963]:     </system>
Nov 30 08:39:41 user nova-compute[74963]:   </sysinfo>
Nov 30 08:39:41 user nova-compute[74963]:   <os>
Nov 30 08:39:41 user nova-compute[74963]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 08:39:41 user nova-compute[74963]:     <boot dev="hd"/>
Nov 30 08:39:41 user nova-compute[74963]:     <smbios mode="sysinfo"/>
Nov 30 08:39:41 user nova-compute[74963]:   </os>
Nov 30 08:39:41 user nova-compute[74963]:   <features>
Nov 30 08:39:41 user nova-compute[74963]:     <acpi/>
Nov 30 08:39:41 user nova-compute[74963]:     <apic/>
Nov 30 08:39:41 user nova-compute[74963]:     <vmcoreinfo/>
Nov 30 08:39:41 user nova-compute[74963]:   </features>
Nov 30 08:39:41 user nova-compute[74963]:   <clock offset="utc">
Nov 30 08:39:41 user nova-compute[74963]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 08:39:41 user nova-compute[74963]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 08:39:41 user nova-compute[74963]:     <timer name="hpet" present="no"/>
Nov 30 08:39:41 user nova-compute[74963]:   </clock>
Nov 30 08:39:41 user nova-compute[74963]:   <cpu mode="custom" match="exact">
Nov 30 08:39:41 user nova-compute[74963]:     <model>Nehalem</model>
Nov 30 08:39:41 user nova-compute[74963]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 08:39:41 user nova-compute[74963]:   </cpu>
Nov 30 08:39:41 user nova-compute[74963]:   <devices>
Nov 30 08:39:41 user nova-compute[74963]:     <disk type="file" device="disk">
Nov 30 08:39:41 user nova-compute[74963]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 08:39:41 user nova-compute[74963]:       <source file="/opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/disk"/>
Nov 30 08:39:41 user nova-compute[74963]:       <target dev="vda" bus="virtio"/>
Nov 30 08:39:41 user nova-compute[74963]:     </disk>
Nov 30 08:39:41 user nova-compute[74963]:     <interface type="ethernet">
Nov 30 08:39:41 user nova-compute[74963]:       <mac address="fa:16:3e:19:af:2f"/>
Nov 30 08:39:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:39:41 user nova-compute[74963]:       <mtu size="1442"/>
Nov 30 08:39:41 user nova-compute[74963]:       <target dev="tap2a2b36cb-98"/>
Nov 30 08:39:41 user nova-compute[74963]:     </interface>
Nov 30 08:39:41 user nova-compute[74963]:     <serial type="pty">
Nov 30 08:39:41 user nova-compute[74963]:       <log file="/opt/stack/data/nova/instances/39358f4b-567d-4e7a-b5d4-aac14df3794b/console.log" append="off"/>
Nov 30 08:39:41 user nova-compute[74963]:     </serial>
Nov 30 08:39:41 user nova-compute[74963]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 08:39:41 user nova-compute[74963]:     <video>
Nov 30 08:39:41 user nova-compute[74963]:       <model type="virtio"/>
Nov 30 08:39:41 user nova-compute[74963]:     </video>
Nov 30 08:39:41 user nova-compute[74963]:     <rng model="virtio">
Nov 30 08:39:41 user nova-compute[74963]:       <backend model="random">/dev/urandom</backend>
Nov 30 08:39:41 user nova-compute[74963]:     </rng>
Nov 30 08:39:41 user nova-compute[74963]:     <controller type="usb" index="0" model="none"/>
Nov 30 08:39:41 user nova-compute[74963]:     <memballoon model="virtio">
Nov 30 08:39:41 user nova-compute[74963]:       <stats period="10"/>
Nov 30 08:39:41 user nova-compute[74963]:     </memballoon>
Nov 30 08:39:41 user nova-compute[74963]:   </devices>
Nov 30 08:39:41 user nova-compute[74963]: </domain>
Nov 30 08:39:41 user nova-compute[74963]:  {{(pid=74963) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2066934095',display_name='tempest-TestMinimumBasicScenario-server-2066934095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2066934095',id=47,image_ref='d2f74598-5e68-40dd-868a-fda52a263308',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8anSMqzswPaAqpKrt3ZnDkK1cAKBT72sIZwSKgmLO5BY5FAk0r0toUAROqTex8ACpmj9LmD+WRNZ+tz76XrnJKgdKxy2CBenXwGpqm4v/sPGKM9jf+QJ0LFwz0Xs5+KA==',key_name='tempest-TestMinimumBasicScenario-1131826780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a4df22008114c12b02eff15a5b3c228',ramdisk_id='',reservation_id='r-aby0hcbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d2f74598-5e68-40dd-868a-fda52a263308',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-171021974',owner_user_name='tempest-TestMinimumBasicScenario-171021974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T08:39:39Z,user_data=None,user_id='c6ad4469500b4c01a5ddf6bf2208e955',uuid=39358f4b-567d-4e7a-b5d4-aac14df3794b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a2b36cb-9883-4681-8f99-09a343a02222", "address": "fa:16:3e:19:af:2f", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2b36cb-98", "ovs_interfaceid": "2a2b36cb-9883-4681-8f99-09a343a02222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converting VIF {"id": "2a2b36cb-9883-4681-8f99-09a343a02222", "address": "fa:16:3e:19:af:2f", "network": {"id": "0efab068-4361-4665-ba76-203ac824b7e8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1741144423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a4df22008114c12b02eff15a5b3c228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2b36cb-98", "ovs_interfaceid": "2a2b36cb-9883-4681-8f99-09a343a02222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:af:2f,bridge_name='br-int',has_traffic_filtering=True,id=2a2b36cb-9883-4681-8f99-09a343a02222,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2b36cb-98') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG os_vif [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:af:2f,bridge_name='br-int',has_traffic_filtering=True,id=2a2b36cb-9883-4681-8f99-09a343a02222,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2b36cb-98') {{(pid=74963) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8faee1f0-aecf-5da7-afbc-dd5c7b57e207', '_type': 'linux-noop'}}, row=False) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a2b36cb-98, may_exist=True, interface_attrs={}) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a2b36cb-98, col_values=(('qos', UUID('983f74d7-3883-47ae-93f8-7b0c3a193651')),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a2b36cb-98, col_values=(('external_ids', {'iface-id': '2a2b36cb-9883-4681-8f99-09a343a02222', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:af:2f', 'vm-uuid': '39358f4b-567d-4e7a-b5d4-aac14df3794b'}),), if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:41 user nova-compute[74963]: INFO os_vif [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:af:2f,bridge_name='br-int',has_traffic_filtering=True,id=2a2b36cb-9883-4681-8f99-09a343a02222,network=Network(0efab068-4361-4665-ba76-203ac824b7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2b36cb-98')
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74963) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 08:39:41 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] No VIF found with MAC fa:16:3e:19:af:2f, not building metadata {{(pid=74963) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 08:39:42 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ff2c759-df48-48af-aa22-b11ba470deea is timed out.
Nov 30 08:39:42 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Successfully detached device vdb from instance 6ff2c759-df48-48af-aa22-b11ba470deea from the live domain config.
Nov 30 08:39:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YpnrjeuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:39:42 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[62620893-03db-4785-b0bd-2b0731435c55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:39:42 user nova-compute[74963]: No targets found.
Nov 30 08:39:42 user nova-compute[74963]: iSNS:
Nov 30 08:39:42 user nova-compute[74963]: No targets found.
Nov 30 08:39:42 user nova-compute[74963]: STATIC:
Nov 30 08:39:42 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60
Nov 30 08:39:42 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:42 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:42 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c
Nov 30 08:39:42 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:42 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:42 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2
Nov 30 08:39:42 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:42 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:42 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62
Nov 30 08:39:42 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:42 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:42 user nova-compute[74963]: FIRMWARE:
Nov 30 08:39:42 user nova-compute[74963]: No targets found.
Nov 30 08:39:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:39:42 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:39:42 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e1cf92-b64e-4f68-9090-718b843f62ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[634b24c8-4b26-48f5-9b70-3d28e20bbb0a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:42 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:42 user nova-compute[74963]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)
Nov 30 08:39:42 user nova-compute[74963]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)
Nov 30 08:39:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:42 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:42 user nova-compute[74963]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 (non-flash)
Nov 30 08:39:42 user nova-compute[74963]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)
Nov 30 08:39:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6220754670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2'): ({'sdd'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Removing single pathed devices sdd {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d6c873-f5cc-407d-adb5-f0460a6a42d3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de086728-d51a-4b8a-9ee7-ba1ff74f19be]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Flushing IO for device /dev/sdd {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[31412f1c-179b-47fd-b4cc-2528ad636dd8]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a3b1dd-5d41-4c12-a68a-e7d148fbaa8c]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] SCSI volumes sdd have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a609e0b-1d4a-4804-ad46-e2127454b37b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[902b6d56-62e9-473f-af4c-a0a7824c36c7]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2, portal: 172.16.0.220,3260]
Nov 30 08:39:42 user nova-compute[74963]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2, portal: 172.16.0.220,3260] successful.
Nov 30 08:39:42 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba2814-c5ba-48d5-b363-29d7b631d93d]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] <== disconnect_volume: return (319ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:42 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-f891035b-43ca-4d5b-9f35-ee98ad030df9 req-b54dc70b-6397-4ed7-892d-95fca4fa0bc2 service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Received event network-vif-plugged-2a2b36cb-9883-4681-8f99-09a343a02222 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f891035b-43ca-4d5b-9f35-ee98ad030df9 req-b54dc70b-6397-4ed7-892d-95fca4fa0bc2 service nova] Acquiring lock "39358f4b-567d-4e7a-b5d4-aac14df3794b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f891035b-43ca-4d5b-9f35-ee98ad030df9 req-b54dc70b-6397-4ed7-892d-95fca4fa0bc2 service nova] Lock "39358f4b-567d-4e7a-b5d4-aac14df3794b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-f891035b-43ca-4d5b-9f35-ee98ad030df9 req-b54dc70b-6397-4ed7-892d-95fca4fa0bc2 service nova] Lock "39358f4b-567d-4e7a-b5d4-aac14df3794b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG nova.compute.manager [req-f891035b-43ca-4d5b-9f35-ee98ad030df9 req-b54dc70b-6397-4ed7-892d-95fca4fa0bc2 service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] No waiting events found dispatching network-vif-plugged-2a2b36cb-9883-4681-8f99-09a343a02222 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:39:43 user nova-compute[74963]: WARNING nova.compute.manager [req-f891035b-43ca-4d5b-9f35-ee98ad030df9 req-b54dc70b-6397-4ed7-892d-95fca4fa0bc2 service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Received unexpected event network-vif-plugged-2a2b36cb-9883-4681-8f99-09a343a02222 for instance with vm_state building and task_state spawning.
Nov 30 08:39:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG nova.objects.instance [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'flavor' on Instance uuid 6ff2c759-df48-48af-aa22-b11ba470deea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-81574618-ae98-4bf9-8250-c93db6cf2139 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.894s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.737s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:43 user nova-compute[74963]: INFO nova.compute.manager [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Terminating instance
Nov 30 08:39:43 user nova-compute[74963]: DEBUG nova.compute.manager [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:43 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-117f41cd-10d4-4d5c-8f58-e26bbc544527 req-7aef8a76-3ad8-4b8b-83c6-94cdf15b1164 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received event network-vif-unplugged-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-117f41cd-10d4-4d5c-8f58-e26bbc544527 req-7aef8a76-3ad8-4b8b-83c6-94cdf15b1164 service nova] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-117f41cd-10d4-4d5c-8f58-e26bbc544527 req-7aef8a76-3ad8-4b8b-83c6-94cdf15b1164 service nova] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-117f41cd-10d4-4d5c-8f58-e26bbc544527 req-7aef8a76-3ad8-4b8b-83c6-94cdf15b1164 service nova] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-117f41cd-10d4-4d5c-8f58-e26bbc544527 req-7aef8a76-3ad8-4b8b-83c6-94cdf15b1164 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] No waiting events found dispatching network-vif-unplugged-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.compute.manager [req-117f41cd-10d4-4d5c-8f58-e26bbc544527 req-7aef8a76-3ad8-4b8b-83c6-94cdf15b1164 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received event network-vif-unplugged-a857b32e-312b-41cb-902f-82d90fe44d70 for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:39:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Instance destroyed successfully.
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.objects.instance [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lazy-loading 'resources' on Instance uuid 6ff2c759-df48-48af-aa22-b11ba470deea {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1226938884',display_name='tempest-VolumesSnapshotTestJSON-instance-1226938884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1226938884',id=43,image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVG1b/xCq6iPVXfB5ZiqfOw0KQYSfQSzPEUrXENGTFeC+VFm+YgQ2ZzY/kPMlL7f+b9sCjpM5UZGYmsDgA/az2UPP9lWrPRUAQvqcQDV8L0aldOr38Z25g+txM5uo/ISQ==',key_name='tempest-keypair-1954909521',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:37:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ac02c3deb7402aa4be7e086036e42d',ramdisk_id='',reservation_id='r-k6cobwlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea262e08-aaf0-444c-be1e-ba1d8691ac72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1296720269',owner_user_name='tempest-VolumesSnapshotTestJSON-1296720269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e0833a93c947b09b71cb3a587e219a',uuid=6ff2c759-df48-48af-aa22-b11ba470deea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converting VIF {"id": "a857b32e-312b-41cb-902f-82d90fe44d70", "address": "fa:16:3e:fd:0d:15", "network": {"id": "19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822726313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ac02c3deb7402aa4be7e086036e42d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa857b32e-31", "ovs_interfaceid": "a857b32e-312b-41cb-902f-82d90fe44d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:0d:15,bridge_name='br-int',has_traffic_filtering=True,id=a857b32e-312b-41cb-902f-82d90fe44d70,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa857b32e-31') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_vif [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:0d:15,bridge_name='br-int',has_traffic_filtering=True,id=a857b32e-312b-41cb-902f-82d90fe44d70,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa857b32e-31') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa857b32e-31, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3906389-f795-4f57-b0f0-28463b010711) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:44 user nova-compute[74963]: INFO os_vif [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:0d:15,bridge_name='br-int',has_traffic_filtering=True,id=a857b32e-312b-41cb-902f-82d90fe44d70,network=Network(19ea4a4f-b3f5-47bd-ae6b-6f17f1354c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa857b32e-31')
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YpnrjeuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:39:44 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d79f8b-501d-4dd7-9e25-dcc75c7c66ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:39:44 user nova-compute[74963]: No targets found.
Nov 30 08:39:44 user nova-compute[74963]: iSNS:
Nov 30 08:39:44 user nova-compute[74963]: No targets found.
Nov 30 08:39:44 user nova-compute[74963]: STATIC:
Nov 30 08:39:44 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60
Nov 30 08:39:44 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:44 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:44 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c
Nov 30 08:39:44 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:44 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:44 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62
Nov 30 08:39:44 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:44 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:44 user nova-compute[74963]: FIRMWARE:
Nov 30 08:39:44 user nova-compute[74963]: No targets found.
Nov 30 08:39:44 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:39:44 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:39:44 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b0874-4e92-45ae-9a4c-855315a49ca2', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd6db3a-f138-4c1d-922c-72bee4942543]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3352d742-201b-4713-a5d0-3488af3a4b0d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:44 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:44 user nova-compute[74963]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)
Nov 30 08:39:44 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:44 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:44 user nova-compute[74963]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)
Nov 30 08:39:44 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244291090>, {}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Disconnecting from: [] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] <== disconnect_volume: return (68ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:39:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Deleting instance files /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea_del
Nov 30 08:39:44 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Deletion of /opt/stack/data/nova/instances/6ff2c759-df48-48af-aa22-b11ba470deea_del complete
Nov 30 08:39:44 user nova-compute[74963]: INFO nova.compute.manager [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 08:39:44 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:39:44 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Instance event wait completed in 0 seconds for  {{(pid=74963) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Guest created on hypervisor {{(pid=74963) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 08:39:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Instance spawned successfully.
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Found default for hw_cdrom_bus of ide {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Found default for hw_disk_bus of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Found default for hw_input_bus of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Found default for hw_pointer_model of None {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Found default for hw_video_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.driver [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Found default for hw_vif_model of virtio {{(pid=74963) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 08:39:45 user nova-compute[74963]: INFO nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Checking state {{(pid=74963) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-00e3d3f8-6dd3-48c7-83e9-80c0b274e723 req-ca87e085-c89f-4934-b373-dcf46dfcdcad service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Received event network-vif-plugged-2a2b36cb-9883-4681-8f99-09a343a02222 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-00e3d3f8-6dd3-48c7-83e9-80c0b274e723 req-ca87e085-c89f-4934-b373-dcf46dfcdcad service nova] Acquiring lock "39358f4b-567d-4e7a-b5d4-aac14df3794b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-00e3d3f8-6dd3-48c7-83e9-80c0b274e723 req-ca87e085-c89f-4934-b373-dcf46dfcdcad service nova] Lock "39358f4b-567d-4e7a-b5d4-aac14df3794b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-00e3d3f8-6dd3-48c7-83e9-80c0b274e723 req-ca87e085-c89f-4934-b373-dcf46dfcdcad service nova] Lock "39358f4b-567d-4e7a-b5d4-aac14df3794b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-00e3d3f8-6dd3-48c7-83e9-80c0b274e723 req-ca87e085-c89f-4934-b373-dcf46dfcdcad service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] No waiting events found dispatching network-vif-plugged-2a2b36cb-9883-4681-8f99-09a343a02222 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:39:45 user nova-compute[74963]: WARNING nova.compute.manager [req-00e3d3f8-6dd3-48c7-83e9-80c0b274e723 req-ca87e085-c89f-4934-b373-dcf46dfcdcad service nova] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Received unexpected event network-vif-plugged-2a2b36cb-9883-4681-8f99-09a343a02222 for instance with vm_state building and task_state spawning.
Nov 30 08:39:45 user nova-compute[74963]: INFO nova.compute.manager [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] [instance: 39358f4b-567d-4e7a-b5d4-aac14df3794b] Took 6.95 seconds to build instance.
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-7cee2d5a-9dc3-4315-bc97-ed4485074e26 tempest-TestMinimumBasicScenario-171021974 tempest-TestMinimumBasicScenario-171021974-project-member] Lock "39358f4b-567d-4e7a-b5d4-aac14df3794b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.051s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:39:45 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Took 0.87 seconds to deallocate network for instance.
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.compute.manager [req-0ecf3d60-1a64-429d-90eb-4eb9f7036d6e req-78165481-8ade-4114-bb02-2c5e366ba209 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received event network-vif-deleted-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:45 user nova-compute[74963]: WARNING nova.volume.cinder [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Attachment ed947998-fbf7-4c58-89a6-9c603b5bc3b6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ed947998-fbf7-4c58-89a6-9c603b5bc3b6. (HTTP 404) (Request-ID: req-e547b213-5bdb-4118-952c-cce2d78bb78e)
Nov 30 08:39:45 user nova-compute[74963]: INFO nova.compute.manager [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Took 0.02 seconds to detach 1 volumes for instance.
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:39:45 user nova-compute[74963]: WARNING nova.virt.libvirt.driver [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b3273f7d-7427-443e-bd17-ab4fb74e61d1 is timed out.
Nov 30 08:39:45 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Successfully detached device vdb from instance b3273f7d-7427-443e-bd17-ab4fb74e61d1 from the live domain config.
Nov 30 08:39:45 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpLWSRzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:39:45 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5c80b6-3def-468d-ad3b-fc137ab3a1ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:39:45 user nova-compute[74963]: No targets found.
Nov 30 08:39:45 user nova-compute[74963]: iSNS:
Nov 30 08:39:45 user nova-compute[74963]: No targets found.
Nov 30 08:39:45 user nova-compute[74963]: STATIC:
Nov 30 08:39:45 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60
Nov 30 08:39:45 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:45 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:45 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c
Nov 30 08:39:45 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:45 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:45 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62
Nov 30 08:39:45 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:45 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:45 user nova-compute[74963]: FIRMWARE:
Nov 30 08:39:45 user nova-compute[74963]: No targets found.
Nov 30 08:39:45 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:39:45 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:39:45 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[30086d93-dff4-43e8-88e1-b02996f38d88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[026186e7-0dcc-4f33-bcab-dfbb5172c61c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:45 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:45 user nova-compute[74963]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)
Nov 30 08:39:45 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:45 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:45 user nova-compute[74963]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 (non-flash)
Nov 30 08:39:45 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244489bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60'): ({'sde'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Removing single pathed devices sde {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ce14f-4a7d-4769-98e2-f9e1035716a0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7448ad2b-ee51-4a0f-9e9b-84cd99623bcf]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Flushing IO for device /dev/sde {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.029s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[62977309-f1d2-4f8c-8f40-e182ca97c03a]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:45 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Deleted allocations for instance 6ff2c759-df48-48af-aa22-b11ba470deea
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0148d0-4d28-434e-be1e-ba05ccc841c3]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] SCSI volumes sde have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cc7ea4-0109-4f08-b0f9-91682dee7f64]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-9bd51c38-13f1-4db9-b13d-56bedc6cbcf6 tempest-VolumesSnapshotTestJSON-1296720269 tempest-VolumesSnapshotTestJSON-1296720269-project-member] Lock "6ff2c759-df48-48af-aa22-b11ba470deea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7aa4a8-7c95-43c2-866e-82c9c0ef334a]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60, portal: 172.16.0.220,3260]
Nov 30 08:39:45 user nova-compute[74963]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60, portal: 172.16.0.220,3260] successful.
Nov 30 08:39:45 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:45 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dd89f-5aa0-4e61-94cb-db411c678d60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ea838a-366a-4ab7-b481-9c309c25c56b]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] <== disconnect_volume: return (342ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] [instance: b3273f7d-7427-443e-bd17-ab4fb74e61d1] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-24e97358-7975-4fef-8cda-af03da4d9a3f req-ee04ef5c-de98-4160-b812-82a14bbdadd0 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received event network-vif-plugged-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-24e97358-7975-4fef-8cda-af03da4d9a3f req-ee04ef5c-de98-4160-b812-82a14bbdadd0 service nova] Acquiring lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-24e97358-7975-4fef-8cda-af03da4d9a3f req-ee04ef5c-de98-4160-b812-82a14bbdadd0 service nova] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-24e97358-7975-4fef-8cda-af03da4d9a3f req-ee04ef5c-de98-4160-b812-82a14bbdadd0 service nova] Lock "6ff2c759-df48-48af-aa22-b11ba470deea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG nova.compute.manager [req-24e97358-7975-4fef-8cda-af03da4d9a3f req-ee04ef5c-de98-4160-b812-82a14bbdadd0 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] No waiting events found dispatching network-vif-plugged-a857b32e-312b-41cb-902f-82d90fe44d70 {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:39:46 user nova-compute[74963]: WARNING nova.compute.manager [req-24e97358-7975-4fef-8cda-af03da4d9a3f req-ee04ef5c-de98-4160-b812-82a14bbdadd0 service nova] [instance: 6ff2c759-df48-48af-aa22-b11ba470deea] Received unexpected event network-vif-plugged-a857b32e-312b-41cb-902f-82d90fe44d70 for instance with vm_state deleted and task_state None.
Nov 30 08:39:46 user nova-compute[74963]: DEBUG nova.objects.instance [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lazy-loading 'flavor' on Instance uuid b3273f7d-7427-443e-bd17-ab4fb74e61d1 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:39:46 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-95e869b3-8948-4d60-8346-f2e3d306b500 tempest-AttachVolumeNegativeTest-1676573190 tempest-AttachVolumeNegativeTest-1676573190-project-member] Lock "b3273f7d-7427-443e-bd17-ab4fb74e61d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.730s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-526d5afb-ba69-4354-b7aa-06e5bcda843b req-7d1714a7-4c3d-4ee2-b45e-e4691affbdcc service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received event network-changed-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:49 user nova-compute[74963]: DEBUG nova.compute.manager [req-526d5afb-ba69-4354-b7aa-06e5bcda843b req-7d1714a7-4c3d-4ee2-b45e-e4691affbdcc service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Refreshing instance network info cache due to event network-changed-01fdc05f-3d59-483a-889c-87bb025b716e. {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 08:39:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-526d5afb-ba69-4354-b7aa-06e5bcda843b req-7d1714a7-4c3d-4ee2-b45e-e4691affbdcc service nova] Acquiring lock "refresh_cache-41d8b782-5b70-48bf-9489-fca44341eff7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 08:39:49 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-526d5afb-ba69-4354-b7aa-06e5bcda843b req-7d1714a7-4c3d-4ee2-b45e-e4691affbdcc service nova] Acquired lock "refresh_cache-41d8b782-5b70-48bf-9489-fca44341eff7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 08:39:49 user nova-compute[74963]: DEBUG nova.network.neutron [req-526d5afb-ba69-4354-b7aa-06e5bcda843b req-7d1714a7-4c3d-4ee2-b45e-e4691affbdcc service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Refreshing network info cache for port 01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 08:39:49 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.network.neutron [req-526d5afb-ba69-4354-b7aa-06e5bcda843b req-7d1714a7-4c3d-4ee2-b45e-e4691affbdcc service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Updated VIF entry in instance network info cache for port 01fdc05f-3d59-483a-889c-87bb025b716e. {{(pid=74963) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.network.neutron [req-526d5afb-ba69-4354-b7aa-06e5bcda843b req-7d1714a7-4c3d-4ee2-b45e-e4691affbdcc service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Updating instance_info_cache with network_info: [{"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-526d5afb-ba69-4354-b7aa-06e5bcda843b req-7d1714a7-4c3d-4ee2-b45e-e4691affbdcc service nova] Releasing lock "refresh_cache-41d8b782-5b70-48bf-9489-fca44341eff7" {{(pid=74963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "41d8b782-5b70-48bf-9489-fca44341eff7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "41d8b782-5b70-48bf-9489-fca44341eff7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:50 user nova-compute[74963]: INFO nova.compute.manager [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Terminating instance
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Start destroying the instance on the hypervisor. {{(pid=74963) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-c051e167-c4c1-44fb-a32f-0126688692d0 req-cc7633a5-8e2e-4f94-9ed0-653fedf6e48e service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received event network-vif-unplugged-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c051e167-c4c1-44fb-a32f-0126688692d0 req-cc7633a5-8e2e-4f94-9ed0-653fedf6e48e service nova] Acquiring lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c051e167-c4c1-44fb-a32f-0126688692d0 req-cc7633a5-8e2e-4f94-9ed0-653fedf6e48e service nova] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-c051e167-c4c1-44fb-a32f-0126688692d0 req-cc7633a5-8e2e-4f94-9ed0-653fedf6e48e service nova] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-c051e167-c4c1-44fb-a32f-0126688692d0 req-cc7633a5-8e2e-4f94-9ed0-653fedf6e48e service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] No waiting events found dispatching network-vif-unplugged-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.compute.manager [req-c051e167-c4c1-44fb-a32f-0126688692d0 req-cc7633a5-8e2e-4f94-9ed0-653fedf6e48e service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received event network-vif-unplugged-01fdc05f-3d59-483a-889c-87bb025b716e for instance with task_state deleting. {{(pid=74963) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: INFO nova.virt.libvirt.driver [-] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Instance destroyed successfully.
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.objects.instance [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lazy-loading 'resources' on Instance uuid 41d8b782-5b70-48bf-9489-fca44341eff7 {{(pid=74963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.virt.libvirt.vif [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T08:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1682838524',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1682838524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1682838524',id=45,image_ref='5a7f9dae-c1c7-459e-a9a9-aa790d04d171',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPVXOferItC4gkHy3NWJGk9JJD4e9GR0GB6njhJhT2Q2LGHFFk/TmvQ3nE9L9Y08K9mZRrdU2x8nUJzRujXAgT+NncUoosqQSo4193r/RrH7fHljR2yMqWNs+mDiHcNvg==',key_name='tempest-keypair-2079079981',keypairs=<?>,launch_index=0,launched_at=2023-11-30T08:38:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c5cd17a85e84d08b5b068935385ca0c',ramdisk_id='',reservation_id='r-w8fkr6pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1848886466',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1848886466',owner_user_name='tempest-TestVolumeBootPattern-1848886466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T08:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='193410ba718b4232a3a4792a584f6834',uuid=41d8b782-5b70-48bf-9489-fca44341eff7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converting VIF {"id": "01fdc05f-3d59-483a-889c-87bb025b716e", "address": "fa:16:3e:61:2a:f4", "network": {"id": "7db9a6c5-afc6-4460-a716-9f1dbb3b90af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-209119790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c5cd17a85e84d08b5b068935385ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fdc05f-3d", "ovs_interfaceid": "01fdc05f-3d59-483a-889c-87bb025b716e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG nova.network.os_vif_util [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:f4,bridge_name='br-int',has_traffic_filtering=True,id=01fdc05f-3d59-483a-889c-87bb025b716e,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fdc05f-3d') {{(pid=74963) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG os_vif [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:f4,bridge_name='br-int',has_traffic_filtering=True,id=01fdc05f-3d59-483a-889c-87bb025b716e,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fdc05f-3d') {{(pid=74963) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01fdc05f-3d, bridge=br-int, if_exists=True) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8b8f55e-eb2f-43a6-a74b-8677f93524e0) {{(pid=74963) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:50 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 08:39:51 user nova-compute[74963]: INFO os_vif [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:f4,bridge_name='br-int',has_traffic_filtering=True,id=01fdc05f-3d59-483a-889c-87bb025b716e,network=Network(7db9a6c5-afc6-4460-a716-9f1dbb3b90af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fdc05f-3d')
Nov 30 08:39:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] calling os-brick to detach iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62443cc310>, {'target_iqn': 'iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHoFIOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 08:39:51 user nova-compute[74963]: WARNING os_brick.initiator.connectors.base [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1330bb-2930-4f28-82b1-989a6cb013d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 08:39:51 user nova-compute[74963]: No targets found.
Nov 30 08:39:51 user nova-compute[74963]: iSNS:
Nov 30 08:39:51 user nova-compute[74963]: No targets found.
Nov 30 08:39:51 user nova-compute[74963]: STATIC:
Nov 30 08:39:51 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c
Nov 30 08:39:51 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:51 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:51 user nova-compute[74963]: Target: iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62
Nov 30 08:39:51 user nova-compute[74963]:         Portal: 172.16.0.220:3260,-1
Nov 30 08:39:51 user nova-compute[74963]:                 Iface Name: default
Nov 30 08:39:51 user nova-compute[74963]: FIRMWARE:
Nov 30 08:39:51 user nova-compute[74963]: No targets found.
Nov 30 08:39:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 08:39:51 user nova-compute[74963]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 08:39:51 user nova-compute[74963]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74963) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c', 0)] {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c50f2a2-6c2a-4d0d-bc41-a7df42f500c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6491b607-6539-4265-9035-1a545cc2e978]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:51 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f971c-91df-4e13-b725-5ac9aa071b62 (non-flash)
Nov 30 08:39:51 user nova-compute[74963]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c (non-flash)
Nov 30 08:39:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6220328b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c'): ({'sdc'}, set())}) {{(pid=74963) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Removing single pathed devices sdc {{(pid=74963) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57573d8-258e-4883-9690-b58853d469aa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[446eb408-a691-4aef-906f-81ead7d61116]: (4, ('ok\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Flushing IO for device /dev/sdc {{(pid=74963) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8509085-b321-4dda-93bb-f33066078cc7]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74963) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0865af0-83b7-4494-8fce-6f074d956a1d]: (4, ('1', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.linuxscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] SCSI volumes sdc have been removed. {{(pid=74963) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c')] {{(pid=74963) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2556bba6-636d-491d-ba6f-d65d96a08e20]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --logout {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14b6de8-c6d5-46a3-90be-b61ba566775e]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c, portal: 172.16.0.220,3260]
Nov 30 08:39:51 user nova-compute[74963]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c, portal: 172.16.0.220,3260] successful.
Nov 30 08:39:51 user nova-compute[74963]:  stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op delete {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cccc812-5249-4278-8e01-39923723650c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb9406a-7e24-4a30-ba8b-52093020fb41]: (4, ('', '')) {{(pid=86506) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74963) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.base [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] <== disconnect_volume: return (321ms) None {{(pid=74963) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Disconnected iSCSI Volume {{(pid=74963) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 08:39:51 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Deleting instance files /opt/stack/data/nova/instances/41d8b782-5b70-48bf-9489-fca44341eff7_del
Nov 30 08:39:51 user nova-compute[74963]: INFO nova.virt.libvirt.driver [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Deletion of /opt/stack/data/nova/instances/41d8b782-5b70-48bf-9489-fca44341eff7_del complete
Nov 30 08:39:51 user nova-compute[74963]: INFO nova.compute.manager [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 30 08:39:51 user nova-compute[74963]: DEBUG oslo.service.loopingcall [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74963) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG nova.compute.manager [-] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Deallocating network for instance {{(pid=74963) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 08:39:51 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] deallocate_for_instance() {{(pid=74963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 08:39:52 user nova-compute[74963]: DEBUG nova.network.neutron [-] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Updating instance_info_cache with network_info: [] {{(pid=74963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 08:39:52 user nova-compute[74963]: INFO nova.compute.manager [-] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Took 0.86 seconds to deallocate network for instance.
Nov 30 08:39:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-2b9389d8-e7e7-4639-bd9c-8c909190201b req-2e7611e3-ede0-4ab9-adee-c73e74cb9e82 service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received event network-vif-deleted-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-d97e49dd-51e3-4b43-b034-baeae5ad47f7 req-a3f9776e-16e2-4b2a-913d-e36c57791f6c service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received event network-vif-plugged-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 08:39:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d97e49dd-51e3-4b43-b034-baeae5ad47f7 req-a3f9776e-16e2-4b2a-913d-e36c57791f6c service nova] Acquiring lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d97e49dd-51e3-4b43-b034-baeae5ad47f7 req-a3f9776e-16e2-4b2a-913d-e36c57791f6c service nova] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:52 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [req-d97e49dd-51e3-4b43-b034-baeae5ad47f7 req-a3f9776e-16e2-4b2a-913d-e36c57791f6c service nova] Lock "41d8b782-5b70-48bf-9489-fca44341eff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:52 user nova-compute[74963]: DEBUG nova.compute.manager [req-d97e49dd-51e3-4b43-b034-baeae5ad47f7 req-a3f9776e-16e2-4b2a-913d-e36c57791f6c service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] No waiting events found dispatching network-vif-plugged-01fdc05f-3d59-483a-889c-87bb025b716e {{(pid=74963) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 08:39:52 user nova-compute[74963]: WARNING nova.compute.manager [req-d97e49dd-51e3-4b43-b034-baeae5ad47f7 req-a3f9776e-16e2-4b2a-913d-e36c57791f6c service nova] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Received unexpected event network-vif-plugged-01fdc05f-3d59-483a-889c-87bb025b716e for instance with vm_state active and task_state deleting.
Nov 30 08:39:53 user nova-compute[74963]: INFO nova.compute.manager [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Took 0.81 seconds to detach 1 volumes for instance.
Nov 30 08:39:53 user nova-compute[74963]: DEBUG nova.compute.manager [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] [instance: 41d8b782-5b70-48bf-9489-fca44341eff7] Deleting volume: 7cccc812-5249-4278-8e01-39923723650c {{(pid=74963) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 08:39:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 08:39:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 08:39:53 user nova-compute[74963]: DEBUG nova.compute.provider_tree [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed in ProviderTree for provider: 41961ac9-576a-4a02-a5e7-459f54657b3f {{(pid=74963) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 08:39:53 user nova-compute[74963]: DEBUG nova.scheduler.client.report [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Inventory has not changed for provider 41961ac9-576a-4a02-a5e7-459f54657b3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74963) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 08:39:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:53 user nova-compute[74963]: INFO nova.scheduler.client.report [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Deleted allocations for instance 41d8b782-5b70-48bf-9489-fca44341eff7
Nov 30 08:39:53 user nova-compute[74963]: DEBUG oslo_concurrency.lockutils [None req-d7eaa660-8b07-4171-abe1-ec97458f8047 tempest-TestVolumeBootPattern-1848886466 tempest-TestVolumeBootPattern-1848886466-project-member] Lock "41d8b782-5b70-48bf-9489-fca44341eff7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.359s {{(pid=74963) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 08:39:54 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:55 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:39:59 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:40:00 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:40:04 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:40:05 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 08:40:09 user nova-compute[74963]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74963) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}